Verified that the module + migration plugin was installed correctly first:

$ drush migrate:status d7_views_migration
 -------------------- -------- ------- ---------- ---------------- ------------- --------------- 
  Migration ID         Status   Total   Imported   Needing update   Unprocessed   Last Imported  
 -------------------- -------- ------- ---------- ---------------- ------------- --------------- 
  d7_views_migration   Idle     19      0          0                19                           
 -------------------- -------- ------- ---------- ---------------- ------------- --------------- 

However...

$ drush migrate:import d7_views_migration
 [error]  The configuration property display.default.display_options.filters.type.value.event doesn't exist. (/home/ide/project/web/core/lib/Drupal/Core/Config/Schema/ArrayElement.php:76) 
 [error]  The configuration property display.default.display_options.filters.type.value.company_profile doesn't exist. (/home/ide/project/web/core/lib/Drupal/Core/Config/Schema/ArrayElement.php:76) 
 [error]  The "published-notpublished" plugin does not exist. Valid plugin IDs for Drupal\Core\Field\FormatterPluginManager are: comment_permalink, comment_username, comment_default, datetime_custom, datetime_default, datetime_time_ago, datetime_plain, file_video, file_rss_enclosure, file_size, file_audio, file_filemime, file_table, file_uri, file_url_plain, file_link, file_default, file_extension, image, image_url, link_separate, link, list_default, list_key, entity_reference_rss_category, text_summary_or_trimmed, text_default, text_trimmed, author, user_name, number_integer, uri_link, email_mailto, basic_string, number_unformatted, timestamp, language, entity_reference_entity_id, timestamp_ago, entity_reference_entity_view, string, entity_reference_label, number_decimal, boolean (/home/ide/project/web/core/lib/Drupal/Component/Plugin/Discovery/DiscoveryTrait.php:53) 
 [error]  The configuration property display.default.display_options.filters.field_result_value.value.Pass doesn't exist. (/home/ide/project/web/core/lib/Drupal/Core/Config/Schema/ArrayElement.php:76) 
 [error]  The configuration property display.default.display_options.filters.type.value.payment_exam_info doesn't exist. (/home/ide/project/web/core/lib/Drupal/Core/Config/Schema/ArrayElement.php:76) 
 [error]  The "active-blocked" plugin does not exist. Valid plugin IDs for Drupal\Core\Field\FormatterPluginManager are: comment_permalink, comment_username, comment_default, datetime_custom, datetime_default, datetime_time_ago, datetime_plain, file_video, file_rss_enclosure, file_size, file_audio, file_filemime, file_table, file_uri, file_url_plain, file_link, file_default, file_extension, image, image_url, link_separate, link, list_default, list_key, entity_reference_rss_category, text_summary_or_trimmed, text_default, text_trimmed, author, user_name, number_integer, uri_link, email_mailto, basic_string, number_unformatted, timestamp, language, entity_reference_entity_id, timestamp_ago, entity_reference_entity_view, string, entity_reference_label, number_decimal, boolean (/home/ide/project/web/core/lib/Drupal/Component/Plugin/Discovery/DiscoveryTrait.php:53) 
 [error]  The configuration property display.default.display_options.filters.type.value.payment_exam_info doesn't exist. (/home/ide/project/web/core/lib/Drupal/Core/Config/Schema/ArrayElement.php:76) 
 [error]  The configuration property display.default.display_options.filters.rid.value.31 doesn't exist. (/home/ide/project/web/core/lib/Drupal/Core/Config/Schema/ArrayElement.php:76) 
 [error]  The configuration property display.default.display_options.filters.rid.value.31 doesn't exist. (/home/ide/project/web/core/lib/Drupal/Core/Config/Schema/ArrayElement.php:76) 
 [error]  The configuration property display.default.display_options.filters.uid_raw.value.value doesn't exist. (/home/ide/project/web/core/lib/Drupal/Core/Config/Schema/ArrayElement.php:76) 
 [error]  The configuration property display.default.display_options.filters.type.value.payment_exam_info doesn't exist. (/home/ide/project/web/core/lib/Drupal/Core/Config/Schema/ArrayElement.php:76) 
 [error]  The configuration property display.default.display_options.filters.type.value.payment_exam_info doesn't exist. (/home/ide/project/web/core/lib/Drupal/Core/Config/Schema/ArrayElement.php:76) 
 [error]  The configuration property display.default.display_options.filters.type.value.payment_exam_info doesn't exist. (/home/ide/project/web/core/lib/Drupal/Core/Config/Schema/ArrayElement.php:76) 
 [error]  The configuration property display.default.display_options.filters.type.value.payment_exam_info doesn't exist. (/home/ide/project/web/core/lib/Drupal/Core/Config/Schema/ArrayElement.php:76) 
 [error]  The configuration property display.default.display_options.filters.rid.value.46 doesn't exist. (/home/ide/project/web/core/lib/Drupal/Core/Config/Schema/ArrayElement.php:76) 
 [error]  The configuration property display.default.display_options.filters.field_result_value.value.Pass doesn't exist. (/home/ide/project/web/core/lib/Drupal/Core/Config/Schema/ArrayElement.php:76) 
  1/19 [▓░░░░░░░░░░░░░░░░░░░░░░░░░░░]   5% [error]  A valid cache entry key is required. Use getAll() to get all table data. (/home/ide/project/web/core/modules/views/src/ViewsData.php:140) 
 [error]  The configuration property display.default.display_options.filters.type.value.course doesn't exist. (/home/ide/project/web/core/lib/Drupal/Core/Config/Schema/ArrayElement.php:76) 
 19/19 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 19 items (1 created, 0 updated, 18 failed, 0 ignored) in 1.3 seconds (870.2/min) - done with 'd7_views_migration'

In MigrateRunnerCommands.php line 350:
                                            
  d7_views_migration migration: 18 failed.                 

These seem to all refer to custom content types/fields.

Comments

webchick created an issue. See original summary.

sundhar’s picture

Status: Active » Needs review
StatusFileSize
new11.3 KB

Views fields from relationships configured.

Views Boolean filters configured.

"published-notpublished","active-blocked" plugins not available in D8. So this plugins resigned to "yes-no" plugin

  • Jeya sundhar committed 616ac26 on 1.0.x
    Issue #3210462: 18/19 views failing to import — where to start debugging...
sundhar’s picture

Status: Needs review » Fixed
webchick’s picture

Hey, awesome, now we're up to 2/19!

 $ drush mim d7_views
 [error]  The configuration property display.default.display_options.filters.type.value.event doesn't exist. (/home/ide/project/web/core/lib/Drupal/Core/Config/Schema/ArrayElement.php:76) 
 [error]  The configuration property display.default.display_options.filters.type.value.company_profile doesn't exist. (/home/ide/project/web/core/lib/Drupal/Core/Config/Schema/ArrayElement.php:76) 
 [error]  The configuration property display.default.display_options.filters.type.value.event doesn't exist. (/home/ide/project/web/core/lib/Drupal/Core/Config/Schema/ArrayElement.php:76) 
 [error]  The configuration property display.default.display_options.filters.field_result_value.value.Pass doesn't exist. (/home/ide/project/web/core/lib/Drupal/Core/Config/Schema/ArrayElement.php:76) 
 [error]  The configuration property display.default.display_options.filters.type.value.payment_exam_info doesn't exist. (/home/ide/project/web/core/lib/Drupal/Core/Config/Schema/ArrayElement.php:76) 
  1/19 [▓░░░░░░░░░░░░░░░░░░░░░░░░░░░]   5% [error]  The configuration property display.default.display_options.filters.type.value.payment_exam_info doesn't exist. (/home/ide/project/web/core/lib/Drupal/Core/Config/Schema/ArrayElement.php:76) 
 [error]  The configuration property display.default.display_options.filters.rid.value.31 doesn't exist. (/home/ide/project/web/core/lib/Drupal/Core/Config/Schema/ArrayElement.php:76) 
 [error]  The configuration property display.default.display_options.filters.rid.value.31 doesn't exist. (/home/ide/project/web/core/lib/Drupal/Core/Config/Schema/ArrayElement.php:76) 
 [error]  The configuration property display.default.display_options.filters.uid_raw.value.value doesn't exist. (/home/ide/project/web/core/lib/Drupal/Core/Config/Schema/ArrayElement.php:76) 
 [error]  The configuration property display.default.display_options.filters.type.value.payment_exam_info doesn't exist. (/home/ide/project/web/core/lib/Drupal/Core/Config/Schema/ArrayElement.php:76) 
 [error]  The configuration property display.default.display_options.filters.type.value.payment_exam_info doesn't exist. (/home/ide/project/web/core/lib/Drupal/Core/Config/Schema/ArrayElement.php:76) 
 [error]  The configuration property display.default.display_options.filters.type.value.payment_exam_info doesn't exist. (/home/ide/project/web/core/lib/Drupal/Core/Config/Schema/ArrayElement.php:76) 
 [error]  The configuration property display.default.display_options.filters.type.value.payment_exam_info doesn't exist. (/home/ide/project/web/core/lib/Drupal/Core/Config/Schema/ArrayElement.php:76) 
 [error]  The configuration property display.default.display_options.filters.rid.value.46 doesn't exist. (/home/ide/project/web/core/lib/Drupal/Core/Config/Schema/ArrayElement.php:76) 
 [error]  The configuration property display.default.display_options.filters.field_result_value.value.Pass doesn't exist. (/home/ide/project/web/core/lib/Drupal/Core/Config/Schema/ArrayElement.php:76) 
  2/19 [▓▓░░░░░░░░░░░░░░░░░░░░░░░░░░]  10% [error]  A valid cache entry key is required. Use getAll() to get all table data. (/home/ide/project/web/core/modules/views/src/ViewsData.php:140) 
 [error]  The configuration property display.default.display_options.filters.type.value.course doesn't exist. (/home/ide/project/web/core/lib/Drupal/Core/Config/Schema/ArrayElement.php:76) 
 19/19 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 19 items (2 created, 0 updated, 17 failed, 0 ignored) in 3.6 seconds (317/min) - done with 'd7_views'

It's probably not really possible to troubleshoot this without more info, so I'll try spinning off individual issues.

sundhar’s picture

Status: Fixed » Needs work
sundhar’s picture

Status: Needs work » Needs review
StatusFileSize
new15.99 KB

Hi webchick,
Last update not configured filter plugins. now its configured.
I think now we're up to 16/19 views will be migrate.

  • Jeya sundhar committed f41c0ed on 1.0.x
    Issue #3210462 by Jeya sundhar: 18/19 views failing to import — where to...
webchick’s picture

Hmmm. Actually, now it's just sitting there hanging after I run drush mim d7_views_migration:

$ cd modules/contrib/views_migration
$ git status
On branch 1.1.x
Your branch is up to date with 'origin/1.1.x'.

nothing to commit, working tree clean
$ drush si --account-pass=admin -y
[snip]
$ drush en views_migration -y
The following module(s) will be enabled: views_migration, migrate, migrate_drupal, migrate_plus

 // Do you want to continue?: yes.                                                   

 [success] Successfully enabled: views_migration, migrate, migrate_drupal, migrate_plus

$ drush ms d7_views_migration
 -------------------- -------- ------- ---------- ---------------- ------------- --------------- 
  Migration ID         Status   Total   Imported   Needing update   Unprocessed   Last Imported  
 -------------------- -------- ------- ---------- ---------------- ------------- --------------- 
  d7_views_migration   Idle     19      0          0                19                           
 -------------------- -------- ------- ---------- ---------------- ------------- ----

$ drush mim d7_views_migration

Whereas the other day stuff started happening immediately.

Nothing in Watchdog.

If I try and check migration messages, I get:

$ drush mmsg d7_views_migration
 [warning] array_keys() expects parameter 1 to be array, null given MigrateRunnerCommands.php:703
 [warning] array_map(): Expected parameter 2 to be an array, null given MigrateRunnerCommands.php:703
 [warning] array_combine() expects parameter 1 to be array, null given MigrateRunnerCommands.php:704
 [error]  TypeError: Return value of Drush\Drupal\Commands\core\MigrateRunnerCommands::getSourceIdKeys() must be of the type array, null returned in Drush\Drupal\Commands\core\MigrateRunnerCommands->getSourceIdKeys() (line 704 of /home/ide/project/vendor/drush/drush/src/Drupal/Commands/core/MigrateRunnerCommands.php) #0 /home/ide/project/vendor/drush/drush/src/Drupal/Commands/core/MigrateRunnerCommands.php(525): Drush\Drupal\Commands\core\MigrateRunnerCommands->getSourceIdKeys()
#1 [internal function]: Drush\Drupal\Commands\core\MigrateRunnerCommands->messages()
#2 /home/ide/project/vendor/consolidation/annotated-command/src/CommandProcessor.php(257): call_user_func_array()
#3 /home/ide/project/vendor/consolidation/annotated-command/src/CommandProcessor.php(212): Consolidation\AnnotatedCommand\CommandProcessor->runCommandCallback()
#4 /home/ide/project/vendor/consolidation/annotated-command/src/CommandProcessor.php(176): Consolidation\AnnotatedCommand\CommandProcessor->validateRunAndAlter()
#5 /home/ide/project/vendor/consolidation/annotated-command/src/AnnotatedCommand.php(311): Consolidation\AnnotatedCommand\CommandProcessor->process()
#6 /home/ide/project/vendor/symfony/console/Command/Command.php(255): Consolidation\AnnotatedCommand\AnnotatedCommand->execute()
#7 /home/ide/project/vendor/symfony/console/Application.php(1027): Symfony\Component\Console\Command\Command->run()
#8 /home/ide/project/vendor/symfony/console/Application.php(273): Symfony\Component\Console\Application->doRunCommand()
#9 /home/ide/project/vendor/symfony/console/Application.php(149): Symfony\Component\Console\Application->doRun()
#10 /home/ide/project/vendor/drush/drush/src/Runtime/Runtime.php(118): Symfony\Component\Console\Application->run()
#11 /home/ide/project/vendor/drush/drush/src/Runtime/Runtime.php(48): Drush\Runtime\Runtime->doRun()
#12 /home/ide/project/vendor/drush/drush/drush.php(72): Drush\Runtime\Runtime->run()
#13 /home/ide/project/vendor/drush/drush/drush(4): require('/home/ide/proje...')
#14 {main}. 
TypeError: Return value of Drush\Drupal\Commands\core\MigrateRunnerCommands::getSourceIdKeys() must be of the type array, null returned in Drush\Drupal\Commands\core\MigrateRunnerCommands->getSourceIdKeys() (line 704 of /home/ide/project/vendor/drush/drush/src/Drupal/Commands/core/MigrateRunnerCommands.php).
 [warning] Drush command terminated abnormally.

Any ideas..?

(I SUPER appreciate your willingness to help; sorry for being such a n00b. :D)

webchick’s picture

Other details that might be relevant?

$ drush status
 Drupal version   : 9.1.7                                                      
 Site URI         : [xxxx]                                                     
 DB driver        : mysql                                                      
 DB hostname      : localhost                                                  
 DB port          : 3306                                                       
 DB username      : [xxx]                                                     
 DB name          : [xxx]                                                    
 Database         : Connected                                                  
 Drupal bootstrap : Successful                                                 
 Default theme    : bartik                                                     
 Admin theme      : seven                                                      
 PHP binary       : /usr/local/php7.4/bin/php                                  
 PHP config       : /usr/local/php7.4/etc/cli/php.ini                          
 PHP OS           : Linux                                                      
 Drush script     : /home/ide/project/vendor/drush/drush/drush                 
 Drush version    : 10.4.3                                                     
 Drush temp       : /tmp                                                       
 Drush configs    : /home/ide/.drush/drush.yml                                 
                    /home/ide/project/vendor/drush/drush/drush.yml             
 Install profile  : standard                                                   
 Drupal root      : /home/ide/project/web                                      
 Site path        : sites/default                                              
 Files, Public    : sites/default/files                                        
 Files, Temp      : /tmp                                                       
sundhar’s picture

StatusFileSize
new29.29 KB

Hi webchick,
I have checked it out,
And figured out something.

If we run drush mmsg d7_views_migration without run any migration its throw exception.

Try this command

$ drush pmu views_migration
 [success] Successfully uninstalled: views_migration
$ drush mmsg d7_user

This will also throw the same exception.

sundhar’s picture

Webchick, Will you share your drush mim errors?

webchick’s picture

Ah-ha. Right you are. I do get the same mmsg error after uninstalling the module entirely. Filed #3212411: Calling drush mmsg before migrations have run causes a pile of errors for that, since I couldn't find an existing issue about it.

After first running into #2868762: D7 Migration failing on d6_filter_format and #3144216: [SOLVED] D7->D8 Migration failing on filter_formats v. filter_format... :P

$ drush mim --tag="Drupal 7"
 1/1 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 1 item (1 created, 0 updated, 0 failed, 0 ignored) in 0 seconds (1327.1/min) - done with 'd7_dblog_settings'
    0 [░░░░░░░░░░░░░░░░░░░░░░░░░░░░]
 [notice] Processed 0 items (0 created, 0 updated, 0 failed, 0 ignored) in 0.1 seconds (0/min) - done with 'd7_file_private'
 1/1 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 1 item (1 created, 0 updated, 0 failed, 0 ignored) in 0 seconds (2217.3/min) - done with 'd7_filter_settings'
 1/1 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 1 item (1 created, 0 updated, 0 failed, 0 ignored) in 0.1 seconds (938.2/min) - done with 'd7_global_theme_settings'
 1/1 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 1 item (1 created, 0 updated, 0 failed, 0 ignored) in 0 seconds (2197/min) - done with 'd7_image_settings'
 1/1 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 1 item (1 created, 0 updated, 0 failed, 0 ignored) in 0.1 seconds (598/min) - done with 'd7_image_styles'
 1/1 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 1 item (1 created, 0 updated, 0 failed, 0 ignored) in 0 seconds (2307.7/min) - done with 'd7_node_settings'
 2/2 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 2 items (2 created, 0 updated, 0 failed, 0 ignored) in 0.1 seconds (1574.6/min) - done with 'd7_search_page'
    0 [░░░░░░░░░░░░░░░░░░░░░░░░░░░░]
 [notice] Processed 0 items (0 created, 0 updated, 0 failed, 0 ignored) in 0 seconds (0/min) - done with 'd7_search_settings'
 1/1 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 1 item (1 created, 0 updated, 0 failed, 0 ignored) in 0 seconds (1723.6/min) - done with 'd7_system_authorize'
 1/1 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 1 item (1 created, 0 updated, 0 failed, 0 ignored) in 0 seconds (1932.4/min) - done with 'd7_system_cron'
 1/1 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 1 item (1 created, 0 updated, 0 failed, 0 ignored) in 0 seconds (1649.7/min) - done with 'd7_system_date'
 1/1 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 1 item (0 created, 0 updated, 0 failed, 1 ignored) in 0 seconds (2682.2/min) - done with 'd7_system_file'
    0 [░░░░░░░░░░░░░░░░░░░░░░░░░░░░]
 [notice] Processed 0 items (0 created, 0 updated, 0 failed, 0 ignored) in 0 seconds (0/min) - done with 'd7_system_mail'
 1/1 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 1 item (1 created, 0 updated, 0 failed, 0 ignored) in 0 seconds (1764.7/min) - done with 'd7_system_performance'
 2/2 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 0 items (0 created, 0 updated, 0 failed, 0 ignored) in 0.1 seconds (0/min) - done with 'd7_theme_settings'
 1/1 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 1 item (1 created, 0 updated, 0 failed, 0 ignored) in 0 seconds (1941.1/min) - done with 'd7_user_flood'
 1/1 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 1 item (1 created, 0 updated, 0 failed, 0 ignored) in 0.1 seconds (1165/min) - done with 'd7_user_mail'
 1/1 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 1 item (1 created, 0 updated, 0 failed, 0 ignored) in 0 seconds (2206.7/min) - done with 'd7_user_settings'

And hangs here...

Well at any rate, seems like the "drush mim is hanging" problem has nothing to do with Views Migration since it's currently still uninstalled... I will do some Googling.

webchick’s picture

Hm. After manually importing d7_user_settings and then re-running things, I get:

$ drush migrate:import --tag="Drupal 7"
 1/1 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 1 item (1 created, 0 updated, 0 failed, 0 ignored) in 0.1 seconds (1110.7/min) - done with 'd7_dblog_settings'
    0 [░░░░░░░░░░░░░░░░░░░░░░░░░░░░]
 [notice] Processed 0 items (0 created, 0 updated, 0 failed, 0 ignored) in 0.3 seconds (0/min) - done with 'd7_file_private'
 1/1 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 1 item (1 created, 0 updated, 0 failed, 0 ignored) in 0 seconds (1974.3/min) - done with 'd7_filter_settings'
 1/1 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 1 item (1 created, 0 updated, 0 failed, 0 ignored) in 0 seconds (1513.2/min) - done with 'd7_global_theme_settings'
 1/1 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 1 item (1 created, 0 updated, 0 failed, 0 ignored) in 0 seconds (1923.7/min) - done with 'd7_image_settings'
 1/1 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 1 item (1 created, 0 updated, 0 failed, 0 ignored) in 0.1 seconds (596.5/min) - done with 'd7_image_styles'
 1/1 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 1 item (1 created, 0 updated, 0 failed, 0 ignored) in 0 seconds (1861.6/min) - done with 'd7_node_settings'
 2/2 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 2 items (2 created, 0 updated, 0 failed, 0 ignored) in 0.1 seconds (830/min) - done with 'd7_search_page'
    0 [░░░░░░░░░░░░░░░░░░░░░░░░░░░░]
 [notice] Processed 0 items (0 created, 0 updated, 0 failed, 0 ignored) in 0 seconds (0/min) - done with 'd7_search_settings'
 1/1 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 1 item (1 created, 0 updated, 0 failed, 0 ignored) in 0 seconds (1364.6/min) - done with 'd7_system_authorize'
 1/1 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 1 item (1 created, 0 updated, 0 failed, 0 ignored) in 0.1 seconds (1178.6/min) - done with 'd7_system_cron'
 1/1 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 1 item (1 created, 0 updated, 0 failed, 0 ignored) in 0.1 seconds (975.9/min) - done with 'd7_system_date'
 1/1 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 1 item (0 created, 0 updated, 0 failed, 1 ignored) in 0 seconds (2512.6/min) - done with 'd7_system_file'
    0 [░░░░░░░░░░░░░░░░░░░░░░░░░░░░]
 [notice] Processed 0 items (0 created, 0 updated, 0 failed, 0 ignored) in 0 seconds (0/min) - done with 'd7_system_mail'
 1/1 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 1 item (1 created, 0 updated, 0 failed, 0 ignored) in 0.1 seconds (1073.3/min) - done with 'd7_system_performance'
 2/2 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 0 items (0 created, 0 updated, 0 failed, 0 ignored) in 0 seconds (0/min) - done with 'd7_theme_settings'
 1/1 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 1 item (1 created, 0 updated, 0 failed, 0 ignored) in 0 seconds (1233.8/min) - done with 'd7_user_flood'
 1/1 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 1 item (1 created, 0 updated, 0 failed, 0 ignored) in 0 seconds (1457/min) - done with 'd7_user_mail'
 1/1 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 1 item (0 created, 1 updated, 0 failed, 0 ignored) in 0 seconds (1418.4/min) - done with 'd7_user_settings'
 1/1 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 1 item (1 created, 0 updated, 0 failed, 0 ignored) in 0 seconds (1763.7/min) - done with 'file_settings'
 1/1 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 1 item (1 created, 0 updated, 0 failed, 0 ignored) in 0 seconds (1559.7/min) - done with 'menu_settings'
 1/1 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 1 item (1 created, 0 updated, 0 failed, 0 ignored) in 0 seconds (1982.8/min) - done with 'system_image'
 1/1 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 1 item (1 created, 0 updated, 0 failed, 0 ignored) in 0.1 seconds (1056.7/min) - done with 'system_image_gd'
 1/1 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 1 item (1 created, 0 updated, 0 failed, 0 ignored) in 0 seconds (1738.6/min) - done with 'system_logging'
 1/1 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 1 item (1 created, 0 updated, 0 failed, 0 ignored) in 0.1 seconds (1009.6/min) - done with 'system_maintenance'
 1/1 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 1 item (1 created, 0 updated, 0 failed, 0 ignored) in 0.1 seconds (1189.1/min) - done with 'system_rss'
 1/1 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 1 item (1 created, 0 updated, 0 failed, 0 ignored) in 0.1 seconds (650.8/min) - done with 'system_site'
 1/1 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 1 item (1 created, 0 updated, 0 failed, 0 ignored) in 0.2 seconds (341.8/min) - done with 'taxonomy_settings'
 1/1 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 1 item (1 created, 0 updated, 0 failed, 0 ignored) in 0.1 seconds (640.9/min) - done with 'text_settings'
 1/1 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 1 item (1 created, 0 updated, 0 failed, 0 ignored) in 0.1 seconds (1105/min) - done with 'update_settings'
 1/1 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 1 item (1 created, 0 updated, 0 failed, 0 ignored) in 0.1 seconds (599.5/min) - done with 'block_content_type'
 1/1 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 1 item (1 created, 0 updated, 0 failed, 0 ignored) in 0.1 seconds (524/min) - done with 'block_content_body_field'
 3/5 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓░░░░░░░░░░░░]  60% [error]  Missing filter plugin: filter_null. 
 5/5 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 5 items (5 created, 0 updated, 0 failed, 0 ignored) in 0.3 seconds (1102.6/min) - done with 'd7_filter_format'
 6/6 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 6 items (6 created, 0 updated, 0 failed, 0 ignored) in 0.3 seconds (1187.6/min) - done with 'd7_custom_block'
 10/10 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 10 items (10 created, 0 updated, 0 failed, 0 ignored) in 1.1 seconds (527.7/min) - done with 'd7_user_role'
  11/151 [▓▓░░░░░░░░░░░░░░░░░░░░░░░░░░]   7% [warning] The "system_menu_block:menu-footer-menu" was not found
 151/151 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 151 items (18 created, 0 updated, 0 failed, 133 ignored) in 6.6 seconds (1382.1/min) - done with 'd7_block'
 1/1 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 1 item (1 created, 0 updated, 0 failed, 0 ignored) in 0.3 seconds (215.5/min) - done with 'block_content_entity_form_display'
 1/1 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 1 item (1 created, 0 updated, 0 failed, 0 ignored) in 0.4 seconds (169.1/min) - done with 'block_content_entity_display'
  6/51 [▓▓▓░░░░░░░░░░░░░░░░░░░░░░░░░]  11% [error]  Attempt to create a field storage field_course with no type. (/home/ide/project/web/core/modules/field/src/Entity/FieldStorageConfig.php:258) 
  9/51 [▓▓▓▓░░░░░░░░░░░░░░░░░░░░░░░░]  17% [error]  Attempt to create a field storage field_location with no type. (/home/ide/project/web/core/modules/field/src/Entity/FieldStorageConfig.php:258) 
 11/51 [▓▓▓▓▓▓░░░░░░░░░░░░░░░░░░░░░░]  21% [error]  Attempt to create a field storage field_track with no type. (/home/ide/project/web/core/modules/field/src/Entity/FieldStorageConfig.php:258) 
 29/51 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓░░░░░░░░░░░░░]  56% [error]  Attempt to create a field storage field_address with no type. (/home/ide/project/web/core/modules/field/src/Entity/FieldStorageConfig.php:258) 
 32/51 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓░░░░░░░░░░░]  62% [error]  Attempt to create a field storage field_candidate with no type. (/home/ide/project/web/core/modules/field/src/Entity/FieldStorageConfig.php:258) 
 51/51 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 51 items (46 created, 0 updated, 5 failed, 0 ignored) in 16.9 seconds (181.3/min) - done with 'd7_field'

In MigrateRunnerCommands.php line 350:
                                 
  d7_field migration: 5 failed.  

(the import command still hangs for d7_views_migration, however...)

...is this what you're looking for?

webchick’s picture

Title: 18/19 views failing to import — where to start debugging? » 16/19 views failing to import — where to start debugging?

I still have no idea what's going on with my install, which is still hanging... but I tried downgrading to Drush 10.3.6 in case that was the issue and it worked for a second before stalling, so I can confirm that yes, we are officially down to 16/19. WOOHOO! :)

$ drush migrate:status d7_views_migration
 ------------------- -------------------- ----------- ------- ---------- ------------- --------------- 
  Group               Migration ID         Status      Total   Imported   Unprocessed   Last Imported  
 ------------------- -------------------- ----------- ------- ---------- ------------- --------------- 
  Default (default)   d7_views_migration   Importing   19      3          16                           
 ------------------- -------------------- ----------- ------- ---------- ------------- --------------- 
sundhar’s picture

Hi webchick,

In this module takes more process to map the real table of the field.

Example:
In D7, If the user & node entity has the same field like field_name. This two fields data has been stored in the same table field_data_field_name. But In D8 site It store two different tables node__field_name and user__field_name. Table mapping takes long process.

We try to reduce the loopings in this functionality.

So that's the problem.

sundhar’s picture

Version: 1.0.8 » 1.1.1

Hi webchick,

Function calling methods changed & Argument plugins configured in new vesion.

sundhar’s picture

StatusFileSize
new789 bytes

Later found why its hanging on, checking field relationship till relationship is none,
In D7 some views version using 'relationship' = 'none' another some views using 'relationship' = ''.

  • Jeya sundhar committed 4af80b2 on 1.1.x
    Issue #3210462 by Jeya sundhar: 16/19 views failing to import — where to...
webchick’s picture

Awesome, thanks so much for all of your work!

Today, after a fresh install with Drupal 9.1.8, Views Migration 1.1.2, and Drush 10.5.0:

$ drush ms d7_views_migration
 -------------------- -------- ------- ---------- ---------------- ------------- --------------- 
  Migration ID         Status   Total   Imported   Needing update   Unprocessed   Last Imported  
 -------------------- -------- ------- ---------- ---------------- ------------- --------------- 
  d7_views_migration   Idle     19      0          0                19                           
 -------------------- -------- ------- ---------- ---------------- ------------- --------------- 

$ drush mim d7_views_migration
 [warning] Invalid argument supplied for foreach() ViewsMigration.php:855
 [error]  TypeError: Argument 1 passed to Drupal\views_migration\Plugin\migrate\source\d7\ViewsMigration::relationshipFieldChage() must be of the type array, null given, called in /home/ide/project/web/modules/contrib/views_migration/src/Plugin/migrate/source/d7/ViewsMigration.php on line 644 in Drupal\views_migration\Plugin\migrate\source\d7\ViewsMigration->relationshipFieldChage() (line 1092 of /home/ide/project/web/modules/contrib/views_migration/src/Plugin/migrate/source/d7/ViewsMigration.php) #0 /home/ide/project/web/modules/contrib/views_migration/src/Plugin/migrate/source/d7/ViewsMigration.php(644): Drupal\views_migration\Plugin\migrate\source\d7\ViewsMigration->relationshipFieldChage()
#1 /home/ide/project/web/modules/contrib/views_migration/src/Plugin/migrate/source/d7/ViewsMigration.php(400): Drupal\views_migration\Plugin\migrate\source\d7\ViewsMigration->alterFiltersDisplayOptions()
#2 /home/ide/project/web/modules/contrib/views_migration/src/Plugin/migrate/source/d7/ViewsMigration.php(239): Drupal\views_migration\Plugin\migrate\source\d7\ViewsMigration->convertDisplayOptions()
#3 /home/ide/project/web/core/modules/migrate/src/Plugin/migrate/source/SourcePluginBase.php(410): Drupal\views_migration\Plugin\migrate\source\d7\ViewsMigration->prepareRow()
#4 /home/ide/project/vendor/drush/drush/src/Drupal/Migrate/MigrateExecutable.php(279): Drupal\migrate\Plugin\migrate\source\SourcePluginBase->next()
#5 /home/ide/project/vendor/drush/drush/src/Drupal/Migrate/MigrateExecutable.php(232): Drush\Drupal\Migrate\MigrateExecutable->handleMissingSourceRows()
#6 [internal function]: Drush\Drupal\Migrate\MigrateExecutable->onPreImport()
#7 /home/ide/project/web/core/lib/Drupal/Component/EventDispatcher/ContainerAwareEventDispatcher.php(142): call_user_func()
#8 /home/ide/project/web/core/modules/migrate/src/MigrateExecutable.php(160): Drupal\Component\EventDispatcher\ContainerAwareEventDispatcher->dispatch()
#9 [internal function]: Drupal\migrate\MigrateExecutable->import()
#10 /home/ide/project/vendor/drush/drush/includes/drush.inc(206): call_user_func_array()
#11 /home/ide/project/vendor/drush/drush/includes/drush.inc(197): drush_call_user_func_array()
#12 /home/ide/project/vendor/drush/drush/src/Drupal/Commands/core/MigrateRunnerCommands.php(348): drush_op()
#13 [internal function]: Drush\Drupal\Commands\core\MigrateRunnerCommands->executeMigration()
#14 /home/ide/project/vendor/drush/drush/src/Drupal/Commands/core/MigrateRunnerCommands.php(298): array_walk()
#15 [internal function]: Drush\Drupal\Commands\core\MigrateRunnerCommands->import()
#16 /home/ide/project/vendor/consolidation/annotated-command/src/CommandProcessor.php(257): call_user_func_array()
#17 /home/ide/project/vendor/consolidation/annotated-command/src/CommandProcessor.php(212): Consolidation\AnnotatedCommand\CommandProcessor->runCommandCallback()
#18 /home/ide/project/vendor/consolidation/annotated-command/src/CommandProcessor.php(176): Consolidation\AnnotatedCommand\CommandProcessor->validateRunAndAlter()
#19 /home/ide/project/vendor/consolidation/annotated-command/src/AnnotatedCommand.php(311): Consolidation\AnnotatedCommand\CommandProcessor->process()
#20 /home/ide/project/vendor/symfony/console/Command/Command.php(255): Consolidation\AnnotatedCommand\AnnotatedCommand->execute()
#21 /home/ide/project/vendor/symfony/console/Application.php(1027): Symfony\Component\Console\Command\Command->run()
#22 /home/ide/project/vendor/symfony/console/Application.php(273): Symfony\Component\Console\Application->doRunCommand()
#23 /home/ide/project/vendor/symfony/console/Application.php(149): Symfony\Component\Console\Application->doRun()
#24 /home/ide/project/vendor/drush/drush/src/Runtime/Runtime.php(118): Symfony\Component\Console\Application->run()
#25 /home/ide/project/vendor/drush/drush/src/Runtime/Runtime.php(48): Drush\Runtime\Runtime->doRun()
#26 /home/ide/project/vendor/drush/drush/drush.php(72): Drush\Runtime\Runtime->run()
#27 /home/ide/project/vendor/drush/drush/drush(4): require('/home/ide/proje...')
#28 {main}. 
TypeError: Argument 1 passed to Drupal\views_migration\Plugin\migrate\source\d7\ViewsMigration::relationshipFieldChage() must be of the type array, null given, called in /home/ide/project/web/modules/contrib/views_migration/src/Plugin/migrate/source/d7/ViewsMigration.php on line 644 in Drupal\views_migration\Plugin\migrate\source\d7\ViewsMigration->relationshipFieldChage() (line 1092 of /home/ide/project/web/modules/contrib/views_migration/src/Plugin/migrate/source/d7/ViewsMigration.php).
 [warning] Drush command terminated abnormally.

Might once again be something on my end. I'll take a poke around.

webchick’s picture

StatusFileSize
new24.17 KB

Ok, in doing some rudimentary debugging, that problem seems to be legitimate, and is coming from the "page_2" display on my "UserSearch" view. Here is an export of the D7 view.

You first get " [warning] Invalid argument supplied for foreach() ViewsMigration.php:858" and then the barf of errors.

If I end up figuring out _why_, I will spin-off a sub-issue for that. But maybe this helps give a pointer somehow?

sundhar’s picture

Hi webchick,
I review the code & find that issue on checking relationships.

  • Jeya sundhar committed 7a35061 on 1.1.x
    Issue #3210462 by Jeya sundhar, webchick: 16/19 views failing to import...
webchick’s picture

That patch seems logical, but for some reason I'm still seeing (more or less) the same problem, even with the tip of the 1.1.x branch:

$ drush ms d7_views_migration
 -------------------- -------- ------- ---------- ---------------- ------------- --------------- 
  Migration ID         Status   Total   Imported   Needing update   Unprocessed   Last Imported  
 -------------------- -------- ------- ---------- ---------------- ------------- --------------- 
  d7_views_migration   Idle     19      0          0                19                           
 -------------------- -------- ------- ---------- ---------------- ------------- --------------- 

$ drush mim d7_views_migration
 [error]  TypeError: Argument 1 passed to Drupal\views_migration\Plugin\migrate\source\d7\ViewsMigration::relationshipFieldChage() must be of the type array, null given, called in /home/ide/project/web/modules/contrib/views_migration/src/Plugin/migrate/source/d7/ViewsMigration.php on line 644 in Drupal\views_migration\Plugin\migrate\source\d7\ViewsMigration->relationshipFieldChage() (line 1096 of /home/ide/project/web/modules/contrib/views_migration/src/Plugin/migrate/source/d7/ViewsMigration.php) #0 /home/ide/project/web/modules/contrib/views_migration/src/Plugin/migrate/source/d7/ViewsMigration.php(644): Drupal\views_migration\Plugin\migrate\source\d7\ViewsMigration->relationshipFieldChage()
#1 /home/ide/project/web/modules/contrib/views_migration/src/Plugin/migrate/source/d7/ViewsMigration.php(400): Drupal\views_migration\Plugin\migrate\source\d7\ViewsMigration->alterFiltersDisplayOptions()
#2 /home/ide/project/web/modules/contrib/views_migration/src/Plugin/migrate/source/d7/ViewsMigration.php(239): Drupal\views_migration\Plugin\migrate\source\d7\ViewsMigration->convertDisplayOptions()
#3 /home/ide/project/web/core/modules/migrate/src/Plugin/migrate/source/SourcePluginBase.php(410): Drupal\views_migration\Plugin\migrate\source\d7\ViewsMigration->prepareRow()
#4 /home/ide/project/vendor/drush/drush/src/Drupal/Migrate/MigrateExecutable.php(279): Drupal\migrate\Plugin\migrate\source\SourcePluginBase->next()
#5 /home/ide/project/vendor/drush/drush/src/Drupal/Migrate/MigrateExecutable.php(232): Drush\Drupal\Migrate\MigrateExecutable->handleMissingSourceRows()
#6 [internal function]: Drush\Drupal\Migrate\MigrateExecutable->onPreImport()
#7 /home/ide/project/web/core/lib/Drupal/Component/EventDispatcher/ContainerAwareEventDispatcher.php(142): call_user_func()
#8 /home/ide/project/web/core/modules/migrate/src/MigrateExecutable.php(160): Drupal\Component\EventDispatcher\ContainerAwareEventDispatcher->dispatch()
#9 [internal function]: Drupal\migrate\MigrateExecutable->import()
#10 /home/ide/project/vendor/drush/drush/includes/drush.inc(206): call_user_func_array()
#11 /home/ide/project/vendor/drush/drush/includes/drush.inc(197): drush_call_user_func_array()
#12 /home/ide/project/vendor/drush/drush/src/Drupal/Commands/core/MigrateRunnerCommands.php(348): drush_op()
#13 [internal function]: Drush\Drupal\Commands\core\MigrateRunnerCommands->executeMigration()
#14 /home/ide/project/vendor/drush/drush/src/Drupal/Commands/core/MigrateRunnerCommands.php(298): array_walk()
#15 [internal function]: Drush\Drupal\Commands\core\MigrateRunnerCommands->import()
#16 /home/ide/project/vendor/consolidation/annotated-command/src/CommandProcessor.php(257): call_user_func_array()
#17 /home/ide/project/vendor/consolidation/annotated-command/src/CommandProcessor.php(212): Consolidation\AnnotatedCommand\CommandProcessor->runCommandCallback()
#18 /home/ide/project/vendor/consolidation/annotated-command/src/CommandProcessor.php(176): Consolidation\AnnotatedCommand\CommandProcessor->validateRunAndAlter()
#19 /home/ide/project/vendor/consolidation/annotated-command/src/AnnotatedCommand.php(311): Consolidation\AnnotatedCommand\CommandProcessor->process()
#20 /home/ide/project/vendor/symfony/console/Command/Command.php(255): Consolidation\AnnotatedCommand\AnnotatedCommand->execute()
#21 /home/ide/project/vendor/symfony/console/Application.php(1027): Symfony\Component\Console\Command\Command->run()
#22 /home/ide/project/vendor/symfony/console/Application.php(273): Symfony\Component\Console\Application->doRunCommand()
#23 /home/ide/project/vendor/symfony/console/Application.php(149): Symfony\Component\Console\Application->doRun()
#24 /home/ide/project/vendor/drush/drush/src/Runtime/Runtime.php(118): Symfony\Component\Console\Application->run()
#25 /home/ide/project/vendor/drush/drush/src/Runtime/Runtime.php(48): Drush\Runtime\Runtime->doRun()
#26 /home/ide/project/vendor/drush/drush/drush.php(72): Drush\Runtime\Runtime->run()
#27 /home/ide/project/vendor/drush/drush/drush(4): require('/home/ide/proje...')
#28 {main}. 
TypeError: Argument 1 passed to Drupal\views_migration\Plugin\migrate\source\d7\ViewsMigration::relationshipFieldChage() must be of the type array, null given, called in /home/ide/project/web/modules/contrib/views_migration/src/Plugin/migrate/source/d7/ViewsMigration.php on line 644 in Drupal\views_migration\Plugin\migrate\source\d7\ViewsMigration->relationshipFieldChage() (line 1096 of /home/ide/project/web/modules/contrib/views_migration/src/Plugin/migrate/source/d7/ViewsMigration.php).
 [warning] Drush command terminated abnormally.
webchick’s picture

StatusFileSize
new52.17 KB

Ok. After some more rudimentary debugging, I think this one is being caused by the reports_partners view. Export attached.

In it, there's a relationship to a field_relationship_tid which presumably doesn't exist yet, since this is the first and only migration I've run. So probably a fair enough problem to have, but maybe some extra hardening is in order to give folks an idea of what to do.

sundhar’s picture

StatusFileSize
new4.16 KB

I analyse your exported view. Its more helpful to find the problem.

This issue occurred by Views Relationships uses All dispalys option. It store the relationships data in default display options. If using 'This block (override)' and it store the relationships data in 'related display(page_1,block_1,etc...) display options'

  • Jeya sundhar committed 758f893 on 1.1.x
    Issue #3210462 by Jeya sundhar, webchick: 16/19 views failing to import...
webchick’s picture

Title: 16/19 views failing to import — where to start debugging? » 1/19 views failing to import — where to start debugging?

OH OH OH!! THINGS ARE HAPPENING!!! :D (Using tip of 1.1.x branch)

$ drush mim d7_views_migration
 [warning] Invalid argument supplied for foreach() ViewsMigration.php:329
  3/19 [▓▓▓▓░░░░░░░░░░░░░░░░░░░░░░░░]  15% [warning] The certification candidate role does not exist. You should review and fix the configuration of the certified_users_directory_admins view. Roles.php:95
  7/19 [▓▓▓▓▓▓▓▓▓▓░░░░░░░░░░░░░░░░░░]  36% [warning] The certification candidate role does not exist. You should review and fix the configuration of the registrations_timeline view. Roles.php:95
 [warning] The certification candidate role does not exist. You should review and fix the configuration of the registrations_timeline view. Roles.php:95
 [warning] The certification candidate role does not exist. You should review and fix the configuration of the registrations_timeline view. Roles.php:95
  8/19 [▓▓▓▓▓▓▓▓▓▓▓░░░░░░░░░░░░░░░░░]  42% [warning] The certification candidate role does not exist. You should review and fix the configuration of the reports_overview view. Roles.php:95
 [warning] The certification candidate role does not exist. You should review and fix the configuration of the reports_overview view. Roles.php:95
 [warning] The certification candidate role does not exist. You should review and fix the configuration of the reports_overview view. Roles.php:95
 [warning] The certification candidate role does not exist. You should review and fix the configuration of the reports_overview view. Roles.php:95
 [warning] The certification candidate role does not exist. You should review and fix the configuration of the reports_overview view. Roles.php:95
 [warning] The certification candidate role does not exist. You should review and fix the configuration of the reports_overview view. Roles.php:95
 [warning] The certification candidate role does not exist. You should review and fix the configuration of the reports_overview view. Roles.php:95
 [warning] The certification candidate role does not exist. You should review and fix the configuration of the reports_overview view. Roles.php:95
 [warning] The certification candidate role does not exist. You should review and fix the configuration of the reports_overview view. Roles.php:95
 [warning] The certification candidate role does not exist. You should review and fix the configuration of the reports_overview view. Roles.php:95
 [warning] The certification candidate role does not exist. You should review and fix the configuration of the reports_overview view. Roles.php:95
 [warning] The certification candidate role does not exist. You should review and fix the configuration of the reports_overview view. Roles.php:95
 [warning] The certification candidate role does not exist. You should review and fix the configuration of the reports_overview view. Roles.php:95
 [warning] The certification candidate role does not exist. You should review and fix the configuration of the reports_overview view. Roles.php:95
 [warning] The certification candidate role does not exist. You should review and fix the configuration of the reports_overview view. Roles.php:95
 [warning] The certification candidate role does not exist. You should review and fix the configuration of the reports_overview view. Roles.php:95
 [warning] The certification candidate role does not exist. You should review and fix the configuration of the reports_overview view. Roles.php:95
  9/19 [▓▓▓▓▓▓▓▓▓▓▓▓▓░░░░░░░░░░░░░░░]  47% [warning] The certification candidate role does not exist. You should review and fix the configuration of the reports_profiles_list view. Roles.php:95
 14/19 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓░░░░░░░░]  73% [warning] The grand master role does not exist. You should review and fix the configuration of the grand_masters view. Roles.php:95
 15/19 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓░░░░░░]  78% [warning] Invalid argument supplied for foreach() ViewsMigration.php:329
 [warning] The certification candidate role does not exist. You should review and fix the configuration of the certified_user_directory view. Roles.php:95
 17/19 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓░░░]  89% [error]  A valid cache entry key is required. Use getAll() to get all table data. (/home/ide/project/web/core/modules/views/src/ViewsData.php:140) 
 19/19 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 19 items (18 created, 0 updated, 1 failed, 0 ignored) in 4.4 seconds (256.6/min) - done with 'd7_views_migration'

In MigrateRunnerCommands.php line 351:
                                           
  d7_views_migration migration: 1 failed.  
                                           

These seem like incredibly legit problems!

ALSO!

$ drush ms d7_views_migration
 -------------------- -------- ------- ------------ ---------------- ------------- --------------------- 
  Migration ID         Status   Total   Imported     Needing update   Unprocessed   Last Imported        
 -------------------- -------- ------- ------------ ---------------- ------------- --------------------- 
  d7_views_migration   Idle     19      18 (94.7%)   0                0             2021-05-13 16:55:29  
 -------------------- -------- ------- ------------ ---------------- ------------- --------------------- 

YEAAAAHHHHH!!! :D

Thank you SO much, @Jeya sundhar! Let me see if I can get to the bottom of that one remaining failing view and we can close out this sucker.

webchick’s picture

StatusFileSize
new40.97 KB

Ok this time the failure seems to be coming from the courses_list view, block_1 display. Export attached.

webchick’s picture

Title: 1/19 views failing to import — where to start debugging? » 1/19 views failing to import

Also ran into this: #3213864: Imported views not shown on admin/structure/views? ... not sure if this is a "me" problem or an "everyone" problem, though.

webchick’s picture

webchick’s picture

Ok, sweet. With the commit of the roles patch (thank you!), error output is now down to:

$ drush mim d7_user_role
 10/10 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 10 items (10 created, 0 updated, 0 failed, 0 ignored) in 1.4 seconds (414.1/min) - done with 'd7_user_role'
views_migrate test:~/project/docroot $ drush mim d7_views_migration
 [warning] Invalid argument supplied for foreach() ViewsMigration.php:331
 15/19 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓░░░░░░]  78% [warning] Invalid argument supplied for foreach() ViewsMigration.php:331
 17/19 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓░░░]  89% [error]  A valid cache entry key is required. Use getAll() to get all table data. (/home/ide/project/web/core/modules/views/src/ViewsData.php:140) 
 19/19 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 19 items (18 created, 0 updated, 1 failed, 0 ignored) in 4.9 seconds (231.1/min) - done with 'd7_views_migration'

In MigrateRunnerCommands.php line 351:
                                           
  d7_views_migration migration: 1 failed.  
                                           
sundhar’s picture

StatusFileSize
new3.56 KB

Hi webchick
Install draggable views module for courses_list view & then migrate the views.
And I remove non existing fields in views.

  • Jeya sundhar committed 09d50c0 on 1.1.x
    Issue #3210462 by Jeya sundhar, webchick: 1/19 views failing to import
    
webchick’s picture

Oh my, isn't it EXTREMELY late for you? :O Thank you for the help! Though, hm. Even applying that patch, and with draggableviews enabled, still same issue:

$ drush mr d7_views_migration
$ wget https://www.drupal.org/files/issues/2021-05-15/RemoveNonExistingFields-3210462-33.patch
$ git apply RemoveNonExistingFields-3210462-33.patch
$ composer require drupal/draggableviews
$ drush en draggableviews -y
$ drush mim d7_views_migration
$ drush mim d7_views_migration
 17/19 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓░░░]  89% [error]  A valid cache entry key is required. Use getAll() to get all table data. (/home/ide/project/web/core/modules/views/src/ViewsData.php:140) 
 19/19 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 19 items (18 created, 0 updated, 1 failed, 0 ignored) in 8.1 seconds (140.4/min) - done with 'd7_views_migration'

In MigrateRunnerCommands.php line 351:
                                           
  d7_views_migration migration: 1 failed.  
                                           
webchick’s picture

More specifically, it seems to be choking on the "reverse_field_track_node" relationship in the courses_list view.

sundhar’s picture

Hi webchick

I have analyse the Courses_list view nearly 4 times.
Last I have understood your content fields & field_types.
Drupal7 has lot of modules and I learn about references in D7. finally i find that problem is node_reference fields aren't migrated to Drupal 9.
I think you are using references module for track & course field.
entity_reverse plugin working with term reference.

sundhar’s picture

StatusFileSize
new762 bytes

References Table field changes

  • Jeya sundhar committed f2aed46 on 1.1.x
    Issue #3210462 by Jeya sundhar, webchick: 1/19 views failing to import
    
sundhar’s picture

Hi webchik

Sandbox: References Migration supports to migrate node_reference to migrate entity_reference.

webchick’s picture

OOOOH exciting! :D However, even installing this sandbox module I seem to be getting the same issue.

# Make sure I'm on the latest code.
$ cd docroot/modules/contrib/views_migration
$ git status
On branch 1.1.x
Your branch is up to date with 'origin/1.1.x'.

nothing to commit, working tree clean
$ git log
commit f2aed461e636bf0101b3960d1f5dc91cd99a17b5 (HEAD -> 1.1.x, origin/1.1.x)
Author: rjeyasundharam <rjeyasundharam@3586597.no-reply.drupal.org>
Date:   Sun May 23 00:19:38 2021 +0530

    Issue #3210462 by Jeya sundhar, webchick: 1/19 views failing to import

# Try importing with just stock views_migration module
$ drush mim d7_user_role
 10/10 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
$ drush mim d7_views_migration
 13/19 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓░░░░░░░░░]  68% [error]  A valid cache entry key is required. Use getAll() to get all table data. (/home/ide/project/web/core/modules/views/src/ViewsData.php:140) 
 [error]  A valid cache entry key is required. Use getAll() to get all table data. (/home/ide/project/web/core/modules/views/src/ViewsData.php:140) 
 19/19 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 19 items (0 created, 17 updated, 2 failed, 0 ignored) in 3.6 seconds (314.4/min) - done with 'd7_views_migration'

In MigrateRunnerCommands.php line 351:
                                           
  d7_views_migration migration: 2 failed.  
                                           
# Ok, download and enable the sandbox project.
$ cd docroot/modules/contrib
$ git clone https://git.drupalcode.org/sandbox/rjeyasundharam-3215737.git references_migration
$ drush en references_migration
 [success] Successfully enabled: references_migration

# Let's try it again.
$ drush mim d7_views_migration
 13/19 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓░░░░░░░░░]  68% [error]  A valid cache entry key is required. Use getAll() to get all table data. (/home/ide/project/web/core/modules/views/src/ViewsData.php:140) 
 [error]  A valid cache entry key is required. Use getAll() to get all table data. (/home/ide/project/web/core/modules/views/src/ViewsData.php:140) 
 19/19 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 19 items (0 created, 17 updated, 2 failed, 0 ignored) in 3.6 seconds (314.4/min) - done with 'd7_views_migration'

In MigrateRunnerCommands.php line 351:
                                           
  d7_views_migration migration: 2 failed.  

Hmmm. Did I do something wrong? Any other info I can give you?

webchick’s picture

For the record, also tried:

drush mim d7_node_type
 7/7 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%

$ drush mim d7_references_field
 3/3 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%

$ drush mim d7_references_field_instance
 3/3 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%

$ drush mim d7_views_migration
 14/19 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓░░░░░░░░]  73% [error]  A valid cache entry key is required. Use getAll() to get all table data. (/home/ide/project/web/core/modules/views/src/ViewsData.php:140) 
 19/19 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 19 items (1 created, 17 updated, 1 failed, 0 ignored) in 4.5 seconds (253.4/min) - done with 'd7_views_migration'

In MigrateRunnerCommands.php line 351:
                                           
  d7_views_migration migration: 1 failed.  
                                           

SO. CLOSE. :D

webchick’s picture

StatusFileSize
new12.44 KB

Oh wait! That's a NEW error!

This time it's about "file_uri" type of field, which is on the "field_badge_image_fid" relationship.

So a file reference field? On the User Certifications view. Which is... here!

sundhar’s picture

Status: Needs review » Needs work
sundhar’s picture

Version: 1.1.1 » 1.1.x-dev
Status: Needs work » Needs review
StatusFileSize
new6.87 KB

Hi webchick :D

In the user_certification view has user reference Its field_name end with field_name"_uid" in Drupal 7 but when we migrate references its changed to field_name"_target_id" then File:Path field is not available in Drupal 8. Before 2 commits I had disabled the removeNonExistFields function, Now its enable for filtering non exist filelds in view display.

  • Jeya sundhar committed 16c436a on 1.1.x
    Issue #3210462 by Jeya sundhar, webchick: 1/19 views failing to import
    
webchick’s picture

Status: Needs review » Needs work

SO sorry for the delay! Thank you so much for working on this!!

Mostly the same problem. Hmmm.

# Initial setup stuff.
cd ~/project/docroot
cd modules
git clone https://git.drupalcode.org/sandbox/rjeyasundharam-3215737.git references_migration
drush en references_migration -y
cd ../

# Import dependencies first.
drush mim d7_user_role
drush mim d7_node_type
drush mim d7_references_field
drush mim d7_references_field_instance

# Drumroll....
$  drush mim d7_views_migration
 12/19 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓░░░░░░░░░░░]  63% [error]  A valid cache entry key is required. Use getAll() to get all table data. (/home/ide/project/web/core/modules/views/src/ViewsData.php:140) 
 19/19 [▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓▓] 100%
 [notice] Processed 19 items (18 created, 0 updated, 1 failed, 0 ignored) in 5.6 seconds (202.6/min) - done with 'd7_views_migration'

In MigrateRunnerCommands.php line 351:
                                           
  d7_views_migration migration: 1 failed.  
                                           

Sorry, I am running out the door and don't have time to debug this right now, but will post more debugging info by Friday.

In the meantime... I wonder if there's a way to at least surface in the error messages which view + field/relationship/etc. is the one that's problematic? That seems like it would allow faster debugging of the problem. (Currently I'm trawling through various variables in XDebug and can never remember where to find the view name so it always takes 10+ minutes. 😅)

sundhar’s picture

I am sorry webchik, I forgot to update the reference_migration patches.(This sandbox module only need for 9.1.x) (Migrate Drupal 7 node/user reference fields supports >9.2.x ) Now reference_migration sandbox updated. once recheck it.

Wow, so great are you using XDebug. My TL Pravin_ajaaz already told about this XDebug method. But my lap has just 4GB RAM. so I didn't use this. But In my case using print_r & vardump is the better debugging method.

sundhar’s picture

Status: Needs work » Needs review
webchick’s picture

Category: Support request » Bug report
Status: Needs review » Fixed

Sadly/Unsadly, due to a job change, I no longer have access to the data that I was basing this analysis on. :)

However, your amazing analysis and debugging accomplished a WHOLE bunch of good for the module, that will help others with similar Views in the future. I'm comfortable marking this fixed. Thanks again. <3

Status: Fixed » Closed (fixed)

Automatically closed - issue fixed for 2 weeks with no activity.