Support for Drupal 7 is ending on 5 January 2025—it’s time to migrate to Drupal 10! Learn about the many benefits of Drupal 10 and find migration tools in our resource center.
Easily import data scraped by the Flatfish Ruby gem into Drupal as custom content types and media.
Basic Information
Flatfish is a Ruby gem for scraping sections of HTML pages and prepping that data for Drupal.
After you've run the Flatfish gem and have your database populated with the scraped data, this module can import that data into Drupal as custom content types (specified by you in the original URL CSV's used by the Flatfish gem) or Media content.
Make sure your Drupal content types exist AND match your Flatfish CSV(s).
Make sure your database, config.yml, and outputted schema.yml are all accessible to Drupal. The config.yml and schema.yml should be in the sites/all/flatfish_migrations directory.
Visit the Flatfish admin config page to register your migrations.
Run the media migration and then any node migrations. (If you forget to run the media migration first, just rerun the nodes with the "update" checkbox enabled.)