Remove and Update button not working with Layout Builder

I am trying to use this Media Library form field in a custom block inside Layout Builder.

I have declared my form field this way:

$form['test_media_image'] = array(
      '#type' => 'media_library',
      '#allowed_bundles' => ['image'],
      '#title' => 'Test Media Library',
      '#description' => '',
      '#default_value' => $config['test_media_image'] ?? null,
      '#required' => false,
    );

I am able to set an image from the Media Library; however, when I try to remove or update the image, it doesn't work.
When I click Remove, an small image appears with the message 'Removing {image name}', but the image remains there.

I've included some logs in your module and can assure that the removeItem function is called and then the processMediaLibrary function, but
I see that the element id is different in both cases.
In the removeItem function, I get this element["#id"]: edit-settings-test-media-image--ywfPbsnEXns and in the processMediaLibrary this different element["#id"]: edit-settings-test-media-image--67mlSTSMapE.

Also, below the image there is this message "The maximum number of media items have been selected".