Custom Data Feeds
- How do I hide, disable, or suppress fields from my data feed?
Follow the instructions below to prevent a field from being written out to the data feed file.
- Go to Manage > Define Fields for your feed.
- Click Edit for the field you want to hide.
- Uncheck the box labeled Enabled and click Update.
- Run another Refresh or Submit task to update your products.
You can still apply filters to disabled fields. Also, the field will still display in the product list on our site, but will be faded out.
Use Case 1
The Standard data feed templates contain fields that, in certain circumstances, you may not wish to submit to the search engine. For example, you may want to suppress optional attributes (those beginning with 'c:') from the Google feed.
The above attributes are generated and submitted as custom attributes for the purposes of keyword optimization. You may prefer to disable them if you do not want those keywords as part of your data feed, or they contain prohibited words that are causing the listings to be rejected.
Use Case 2
Suppose you have a custom field in your store such as "cpc-submit". You set it to 'Yes' when you feel the product will provide a return on investment in a CPC-based shopping engine.
In this scenario, you can add a filter to exclude the products by this field, but leave the field disabled so that it is not submitted in the data feed. Now, directly from your store catalog, you have fine-grained control over the products being submitted.
- HeidiSQL Setup and Usage Instructions for Custom Feeds
If you have been provided with a MySQL database for your data feeds, please use the instructions below to get started.
First, download and install the freeware HeidiSQL software from the HeidiSQL Downloads page. Select the latest HeidiSQL Installer.
In order to set up your database connection, follow these steps.
- Run HeidiSQL
- Click the New button in the Session Manager.
- Enter the following on the Settings tab of the New Connection Dialog:
- Session name: mysql.atensoftware.com
- Network type: MySQL (TCP/IP)
- Hostname: mysql.atensoftware.com
- User: provided by us
- Password: provided by us
- Port: 3306
- Check the Compressed client/server protocol box.
- Leave all other settings at defaults.
- Click Open to connect to the database.
Conventions
Tables whose names start with edit_ are tables where you can enter information for your feed.
The fields that start with an underscore are system fields that should not be edited, and may be updated automatically.
You can edit data in any of the fields that do not start with an underscore.
Data in the edit_ tables is generally refreshed and/or incorporated into your feed each time your data feed is refreshed or submitted from our site.
Please contact us for the specifics of your setup.
Tips
Click the Data tab after selecting a table to see a spreadsheet-like view of the data. There are several buttons in the upper-right corner of the data area that will make your life much easier.
By default, only the first 1,000 records are displayed. Use the Next and Show all buttons to display more records.
Click the Columns button to show/hide columns. This is especially handy if there are many columns and you need to focus on just a few.
You can click the column headings to sort by a column. Click the Sorting button to fine-tune the sort order.
Click the Filter button to filter the data. Here are some common SQL expressions you can use - remember to use the field names specific to your table.
_code = 'abc123'
- Find a record with a specific code.
_title LIKE 'abc%'
- Find records with title's that start with abc.
_description LIKE '%free%'
- Find records where the description contains the text free.
_price < 20
- Find records where price is less then 20.
For more information on the features of HeidiSQL, check out the HeidiSQL screen shots.
- Can I downgrade a Custom feed to a Standard feed?
It is not possible to directly downgrade Custom feeds due to the possible customizations they may have. The easiest option is for you to contact us and we can manually remove the customizations. Another option is to simply add a new, Standard feed for that store and shopping engine. Configure this new feed based on the Standard feed. Once you are done, you can delete the Custom feed.
- Automatically Removing Duplicate SKUs from your Product Catalog
Some store platforms, allow you to enter the same SKU for multiple items. This causes problems in the feeds because the shopping engines do not allow you to submit multiple product listings with the same identifier.
If our system detects duplicate SKUs in your catalog, it will show you an error message with the SKUs that are duplicated. You will also receive an email with the error message.
The best solution is to edit your product catalog and remove the duplicate SKUs manually. If that is not possible, we have several options for automatically removing the duplicate SKUs, as listed below:
- 'error' mode - the feeds show an error and sends you an email if duplicate SKUs are detected
- 'kill' mode - delete duplicate SKUs entirely (you will not see duplicate SKU errors anymore, but those SKUs will be completely gone)
- 'safe' mode - reduce duplicate SKUs to one SKU only if the all the other product data is identical (you may still get duplicate SKU errors if for some reason the product data is not identical)
- 'sort' mode - reduce duplicate SKUs to one SKU by applying a sort and picking the first record (you won't see duplicate SKU errors anymore) You need to specify the fields to sort by.
The 'error' mode is the default mode for almost all the feeds. Please contact us if you would like us to configure a specific mode for your feed.
- Simple programmed rules for Standard Feeds
The Standard feed service now supports simple, programmed rules for no extra monthly charge. These types of modifications can greatly optimize your feed and boost your ad rank.
We program these rules directly into your feed using PHP code, so we have much more flexibility than other systems. Other systems require you to manually enter cookie-cutter rules through a cumbersome, difficult to use interface. With our system, you just email us and we take care of it.
If you need some logic programmed into the feed, please send us your requirements and we can give you a quote. Depending on the work involved, we may do the programming for no charge.
For more advanced logic like inventory updates, you may require a Custom Feed. Otherwise, simple rules can cover the scenarios listed below.
- Append, prepend, or concatenate (combine) one field with another field (e.g. append title to the description, and brand to the title)
- Apply a simple price markup or adjustment (e.g. add VAT tax)
- Translate unsupported values to supported values (e.g. translate "remanufactured" to "refurbished")
- Find and replace, or remove text strings
- Change case (e.g. change all-caps titles to title case)
- Enforce MAP pricing
- Multiply price times minimum order quantity to get minimum price
- Automatic 'Smart' fields for Shopping feeds
Our feeds now support 'smart' apparel, GTIN, and product_type attributes, which greatly improve the data quality scores for retailers of all types.
These fields are computed from your product data using proprietary scoring algorithms, keyword lists, and parsing patterns refined over the years from experience with multiple retailers. We studied the Google Product Feed specifications closely to get the best results.
These fields are completely automatic, and enabled by default on most feeds. Because this automatic optimization is the secret sauce of our system, we do not post too many details publicly. If you have more specific questions, please contact us.
For example, 'color' is often mapped to 'option_color' by most feed generators. In many cases, 'option_color' is blank because the product has no variations. This results in low data quality scores. Our system will search in other appropriate fields for valid color names if 'option_color' is not found.
Apparel Fields
- size
- Automatic detection
- color
- Automatic detection
- gender
- Automatic detection
- age_group
- Automatic detection
- size_system
- Automatic detection
- size_type
- Automatic detection
Other Fields
- product_type
- Chooses most appropriate product descriptive category from among all categories assigned to the item. Removes non-descriptive keywords.
- gtin
- Automatically detects UPC/EAN, with auto-correction and check-digit validation
Other Languages/International Feeds
We support smart field logic for the following languages:
- English (en)
- German (de)
- Spanish (es)
- Italian (it)
- French (fr)
If you have feeds in any of the languages listed above, our system can detect color, size, gender, and age group values automatically.
- size
- Request for Quote Questionnaire for Inventory Management Supplier Feed
Please answer the questions below so that we can prepare your quote for the supplier to store data synchronization feed. This type of feed reads data from your supplier, and automatically creates, updates, and/or deletes products in your online store on a Daily basis. It will sync products, options, inventory, and image data. Scheduling frequency is flexible.
- What is the source of the supplier's product data? (e.g. a fixed URL, API, database, email, etc.)
- What is the destination store URL and platform? (e.g. Shopify, BigCommerce, etc.)
- How often does the feed need to run? (e.g. one-time only, daily, hourly, etc.)
- If a product does not exist in your store, does it need to be created by the feed? (Yes or No)
- If a product already exists in your store, does it need to be updated? (Yes or No)
- If a product is in your store, but not in the supplier data, what should happen? (delete the product, mark it disabled/hidden, do nothing, etc.)
- How do you identify this supplier's products in your store? (supplier's name stored in a field, a SKU prefix, etc.)
- What type of pricing rules need to be applied? You do not need to provide any specifics. (e.g. no change, fixed markup, configurable markup, markup table, custom rules, etc.)
- Are there any other rules or filters that need to be implemented?
- How to run a Supplier feed update
This article assumes you provide your supplier inventory/product data file (typically CSV, XLS, or XML format) by FTP to atensoftware.com.
- Using your FTP Client (such as WsFTP, FileZilla, CuteFTP, WinSCP, etc.), log into ftp.atensoftware.com using the username and password provided by us.
- Upload your supplier file to the server with the same name as the existing file, overwriting the existing file.
- Go to My Account.
- Click Manage for the Product Update supplier feed.
- Click the Submit button
- Can I provide you PHP code of rules/conditions on feed attributes?
Yes, you can provide PHP code of feed data transformation rules to apply to your data feeds.
It is not possible to enter the code directly into our system, for obvious security reasons. However, you are welcome to email the code to us and we can plug it in for you.
There is a custom row transform function that runs once the feed data is generated. It takes a
$row
parameter which is an array that contains every field in the feed listed on the Define Fields page, as well as any raw data field listed in Analzye Source Data page.Here's a common example:
if($row['mpn'] == '') { $row['mpn'] = $row['id']; }
Feel free to use any PHP code. We will review it and let you know if there is anything off-limits.
The Standard feed plan can accommodate about a page worth of basic rules. If the rules are going to be very complex, we might ask you to upgrade to a Custom feed.