[meeting] Migrate Meeting 2022-07-28 1400Z [#3300474]

Hello all, it’s time for the weekly migration subsystem meeting. The meeting will take place in slack in various threads
This meeting:
➤ Is for core migrate maintainers and developers and anybody else in the community with an interest in migrations
➤ Usually happens every Thursday and alternates between 1400 and 2100 UTC.
➤ Is done on the #migration channel in Drupal Slack (see www.drupal.org/slack for information).
➤ Happens in threads, which you can follow to be notified of new replies even if you don’t comment in the thread. You may also join the meeting later and participate asynchronously!
➤ Has a public agenda anyone can add to. See the parent issue for an idea of the typical agenda.
➤*Transcript will be exported and posted* to the agenda issue. For anonymous comments, start with a :bust_in_silhouette: emoji. To take a comment or thread off the record, start with a :no_entry_sign: emoji.

Core migration issues

Video meeting 2022-10-13 2100Z (tentative)

The hope is that most or all of the maintainers will attend. We will try to focus on longer-term goals than in the weekly meeting.

0️⃣ Who is here today?

mikelutz (he/him)	me! me! I’m here!
mradcliffe	I'm here again.
bsnodgrass (he/him)	here, mostly as a fly on the wall, to stay plugged into the latest. bsnodgrass from St Charles IL far western burbs of Chicago.
quietone	Hi

1️⃣ What should we talk about today? Suggest topics here and I will add threads. I will also check for comments on the issue for today's meeting.

benjifisher

Update on #3260111: Regression AND bug: SQLite source and id map tables aren't joinable anymore, but SqlBase::mapJoinable() is unaware of this

2️⃣ Action items. To be added later.

benjifisher	Review #3063856: Add ability to view migrate_message table data. @benjifisher
benjifisher	Review #3262395: $migration_dependencies has inconsistent structure (and hopefully get it back to RTBC). Volunteer needed.
benjifisher	Check on #3260111: Regression AND bug: SQLite source and id map tables aren't joinable anymore, but SqlBase::mapJoinable() is unaware of this once the latest test finishes. @benjifisher

3️⃣ Statistics

benjifisher	Fixed since last week's meeting: 0 (not counting the issue for the meeting).
benjifisher	RTBC: 4, 1 of which is Critical.
benjifisher	NR: 21, including 3 Major and 2 that have not been updated in more than two months.
benjifisher	Google sheet for recording stats: https://docs.google.com/spreadsheets/d/1o0Rjlc1vnnLP5bM5P-SMMyGzqn7258hi... (needs update for today)
benjifisher	Two of the NR issues are for meetings, so call it 19 instead of 21.I updated the spreadsheet.

4️⃣ Comment in this thread if you are looking for ways to help. Give us some idea of what you would like to do: documentation, code review, testing, project management, ...

mradcliffe	I've been trying to find time to document my recent migration experiences for "ambitious digital experience" sites.
mradcliffe	Mainly having to do with setting up an initial drupal upgrade to migrate configuration and initial content so that site building can take place while doing incremental content migrations. (edited)
benjifisher	Is there anything we can do to help? Other than creating more time for you?That is definitely the approach we should be promoting. I even think that we should provide an option in the UI to run just the Config migrations or just the Content migrations. Do we have an issue for that?
mradcliffe	I was thinking of writing a blog post, but I think there was some chatter a couple months back about a "tips & tricks" documentation page/guide, but I don't know if an unstructured page helps.
benjifisher	I think this is a bigger topic than a "tip or trick".
mradcliffe	https://www.drupal.org/docs/upgrading-drupal/choosing-the-upgrade-approa... probably could be a starting point for a sub-page
mradcliffe	I briefly also started investigating splitting out migrate_tools' migrate:upgrade --configure-only into its own command that would handle additions / replacements, but it looked like a lot of work.
benjifisher	I think that is a page, not a guide, so it cannot have child pages. If you want to add a sibling page, then I can add it to the menu of the guide.
mradcliffe	I think my thoughts aren't structured enough for anything actionable.
benjifisher	You can add a new page and do a brain dump. Until I add it to the menu, no one will stumble across it and embarrass you (or get confused).The journey of a thousand miles begins with a single step.
benjifisher	@bsnodgrass (he/him), @robpowell: you commented in this thread two weeks ago, but after the regular meeting time. Are you still looking for ways to contribute?
bsnodgrass (he/him)	Yes I am... more on using migration ui tools to learn more about gaps and why/when/what to plan on for custom migration steps
bsnodgrass (he/him)	Also is there any documentation/instruction for a recommended process to set up source / target instances?@benjifisher :point_up::skin-tone-3:I came on late due to a visit to the vet... just wanted to make sure you saw that (edited)
robpowell	@benjifisher I was out last week, let me know where I can be most helpful.

5️⃣ Previous minutes.

benjifisher	NR: #3296087: [meeting] Migrate Meeting 2022-07-21 2100Z(issue for last week's meeting)
benjifisher	That was the quarterly video meeting. Recording: https://www.youtube.com/watch?v=ZYnC4hGfCck
benjifisher	NR: #3294837: [meeting] Migrate Meeting 2022-07-14 1400Z (2022-07-14)

6️⃣ Announcements

benjifisher	Re-post from 5️⃣: recording of last week's video meeting https://www.youtube.com/watch?v=ZYnC4hGfCck
mikelutz (he/him)	ugh.. you made that public without asking me? :stuck_out_tongue:
mikelutz (he/him)	I sound like I have COVID..
benjifisher	@bsnodgrass (he/him)

7️⃣ $migration_dependencies has inconsistent structure

benjifisher	#3262395: $migration_dependencies has inconsistent structure
benjifisher	This is critical and was RTBC. The only recent change is that I updated it to target the 10.1.x branch, since it includes deprecations. Can someone check that I did not do any damage when rebasing?
mradcliffe	This still shows that it cannot be merged for me.
mradcliffe	Wait, the issue summary just changed to mergeable after I clicked into the merge request and clicked back.
mradcliffe	Though the merge request still shows it's blocked on a rebase.
benjifisher	Yet the test passed on July 24.I think that MRs are finicky when it comes to changing branches. Let me double check that the issue targets 10.1 and the MR targets 10.1.x ...
benjifisher	Do I dare click the "Rebase" button? I suppose I can fix it if it breaks something.
benjifisher	It looks like it worked:
benjifisher	The test passed. :+1:

8️⃣ Expose full set of debugging data in migrate_message table (filterable/searchable)

benjifisher	#3063856: Add ability to view migrate_message table data
benjifisher	This is Major, NR. It is next on my priority list.
mikelutz (he/him)	I haven’t looked much at this one, but it would be nice to get over the finish line.
benjifisher	I am assigning it to myself in 2️⃣.

9️⃣ Regression AND bug: SQLite source and id map tables aren't joinable anymore, but SqlBase::mapJoinable() is unaware of this

benjifisher	#3260111: Regression AND bug: SQLite source and id map tables aren't joinable anymore, but SqlBase::mapJoinable() is unaware of this
benjifisher	This is the remaining Major issue in NR status. I have not looked at it myself.
benjifisher	@wimleers (he/him), @huzooka: see Mike's comment #17,... let's get this pushed through. If Wim or Huzooka can confirm they are happy with the last patch, and it passes, I'll get this to RTBC.
benjifisher	But the patch did not pass. It passed when tested with MySQL (so it did not break anything there) but it failed with SQLite.I think the status should be NW. Any objections?
mikelutz (he/him)	It fails on sqllite due to a jittery javascript test being worked on elsewhere according to quietone, might just need to be requeued
benjifisher	Let's not both queue a re-test. Shall I?
benjifisher	queued
benjifisher	It looks like a pretty simple patch.
benjifisher	The retest passed, so we are waiting for a comment from Wim or Huzooka, or someone else who is affected by the bug.

1️⃣0️⃣ Wrap up

benjifisher	Thanks for participating! I already updated 2️⃣. Please continue to add comments in the threads. In 1-7 days, we will post a transcript for today's meeting.
quietone	@benjifisher, thanks for herding the cats!
benjifisher	:cat::cat2: :cat-on-keyboard: :cat_smile-grin: :crying_cat_face: :kissing_cat: :smirk_cat: :pouting_cat: :joy_cat: :heart_eyes_cat: :pusheen: :smiley_cat: