Magento 1.5 Product Import/Export – First Take

February 28th, 2011 Posted by Public 14 comments on “Magento 1.5 Product Import/Export – First Take”

Recently I upgraded from Magento Community 1.4 to 1.5 to take advantage of the next import and export features released in 1.5.  These updates are intended to finally fix the major pain point for many Magento users – it is not easy to import or export products and customers, especially on shared servers or machines with lower resource levels.

I had a specific need to export all of my products, clean the catalog data and import back to Magento.  Here are some things I have found so far.

#1 Menu Location

The new import and export features are in “System > Import/Export > Import” and “System > Import/Export > Export” – the old/legacy profiles have been renamed “Dataflow – profiles” and “Dataflow – Advanced Profiles”

#2 Options

The first screen has two main options “Products” and “Customers” and an option for file type (.csv is the only option)

#3 Products – Detailed Options

Once you select “Products” you have the option to restrict the products included in the .csv file.  This is a much larger list of options than the previous version and nice to see.

(screenshot too large to include)

#4 Run Job

To run the job with the parameters you have specified click the “Continue” button in the lower right to create the file.

Note:  In my case I was trying to export 16,000+ products on a shared server with limited resources (my staging site) and ran into memory errors.  To fix the issue I had to restrict the products exported by setting price ranges in the export and change the ranges until I had a small enough memory usage.

#5 File Created

#5 Resulting File – Columns found in .csv

The following columns were exported:
sku
_store
_attribute_set
_type
_category
_product_websites
color
cost
created_at
custom_design
custom_design_from
custom_design_to
custom_layout_update
description
enable_googlecheckout
gallery
gift_message_available
has_options
image
image_label
is_imported
manufacturer
media_gallery
meta_description
meta_keyword
meta_title
minimal_price
name
news_from_date
news_to_date
options_container
page_layout
price
prices
required_options
short_description
small_image
small_image_label
special_from_date
special_price
special_to_date
status
tax_class_id
thumbnail
thumbnail_label
updated_at
url_key
url_path
visibility
weight
qty
min_qty
use_config_min_qty
is_qty_decimal
backorders
use_config_backorders
min_sale_qty
use_config_min_sale_qty
max_sale_qty
use_config_max_sale_qty
is_in_stock
notify_stock_qty
use_config_notify_stock_qty
manage_stock
use_config_manage_stock
use_config_qty_increments
qty_increments
use_config_enable_qty_increments
enable_qty_increments
_links_related_sku
_links_related_position
_links_crosssell_sku
_links_crosssell_position
_links_upsell_sku
_links_upsell_position
_associated_sku
_associated_default_qty
_associated_position
_tier_price_website
_tier_price_customer_group
_tier_price_qty
_tier_price_price

Note: With my memory restriction I had to create a bunch of these files and manually add them all to a single excel file.

Using this method I was able to export over 16,000 SKUs from a shared server environment in a little over 1 hour.  The export job itself is very much improved from the previous versions and I am happy with the results so far.

Now on to the update and import process, I want to be able to do the following:

  • Change product titles in the export file and import them back to Magento in Bulk
  • Modify the catalog taxonomy and add/change categories by changing in the data file
  • Configure complex products (grouped, configurable, etc) directly in the data file.
  • Reload the updated data feed without experiencing memory issues and failures
  • Reindex the site to pick up the new catalog

I don’t know how many of my wish list items will work… off to begin testing.

Tags: , , , ,
  • Webmaster

    We had the same problems with the allowed memory size. This post helped us very much! We now filter on manufacturer, and everything works fine.

  • Jason

    I was having a problem importing the products from 1.4 because I didn’t realize that you had to copy the media>catalog>product all the folders within this folder to media > import in version 1.5….hope this helps I kept getting an error on import saying error:no image

  • Kyle

    Any follow up on how well the edit/update and import went regarding the topics you listed at the end of your post?

    • Anonymous

      Kyle – I do have some updates and have been meaning to post them. I will do a full post but here are the highlights.

      1. Change Product Titles – Worked
      2. Change Taxonomy – Not Possible OOB, I have seen some work around solutions on the Magento Forums but have not personally tried them
      3. Complex Products – Not Possible, I am working with the Magento Core team on an Enterprise project and they let me know its not currently possible. I am considering writing a catalog extension with a former Magento Architect but nothing exists today that I am aware of.
      4. Reload – Worked
      5. Re-index – I am afraid to try this, especially the catalog search index (it took me a long time to get it to finish in the first place) – My updates are showing in search results.

      I hope this helps!
      Nick

      • Joead

        Hi Nick,

        Did you write an extension to import complex products? I need an import solution that handles grouped products and it’s associated simple products.

        • Nick Cron

          Not yet, my contacts at Magento say this is not going to be supported until Magento 2.0 (which may or may not ever come out with the Ebay acquisition)

      • HubZ

        3. Complex Products – Not Possible,
        > You should try MAGMI it is simple and faster !

        Thanks for sharing your experiences here, it’s useful, and if i can be also, it’s a pleasure !

        HubZ

      • Dave

        I have managed to upload complex products as at March 2012 on 1.6.0.0

  • http://www.magento-themes.jextn.com/ magento themes

    Using this method we can export 16 k products in to it. Although it is very difficult to find each and every product details. it takes lot of time in doing it so ..

  • Anonymous

    If export the file and edit the manufacturers for each product, will this fill in the “name” description for each product so that it is displayed with the product description on the website.

    Sorry if I am not clear. I am no developer and I don'[t know all of the terms to use. Our site http://www.myfatpig.com has 30,000 products on it and the manufacturer will not show up in the title for any products.

    For instance, right now when you visit the site, our homepage products displayed may say 19″ LED Monitor. But we want the manufacturer displayed in front of that title. We need this done for all of our products. 

    Is there an easy way? Is that what this post is referring to? 

  • Roselinmary

    As of now we are having 30k products. when we import the data, refreshing the reindex took more time. how can i reduce reindexing time? can anyone help me..

  • Umair Khan

    I have integrated my products from ebay. I have them in back end of my magento community product but cant find the way to show them on my store on frontend. If there is any way to show them on front end 

  • http://touchwebsitesolutions.com/ website design services

    This is working on Magento 1.5 too. Just you need to add a column in csv ‘has_options’ & set the value to ‘1’ for the products which are having custom options.

    • Shilpashree

      hi im using magento 1.4. i see the field has_options in the import file. could you please how should i be specifying custom options in the import file?