Icecat Release Notes 252: Enhanced Related Products Export, Improved Matching Accuracy, and New User Engagement Capabilities

By
Release Notes

Release 252 introduces a range of improvements across product data exports, matching accuracy, reporting, user engagement, and platform operations. This release enhances how related products are delivered via Product XML, improves the accuracy of matching statistics, expands reporting capabilities, and introduces new mechanisms to support customer retention and data quality. Alongside these user-facing enhancements, Icecat continues to invest in platform reliability, performance, and long-term maintainability through a series of behind-the-scenes improvements. For additional details, please refer to the previous Icecat Release Notes.  

Improved Related Products Export in Product XML

We have enhanced the way related products are exported in Product XML.

Related products have been available in Product XML for a long time. With this release, the export logic has been redesigned to provide more structured, relevant, and consistent results.

Related products are now grouped by relation type and processed through a filtering pipeline before being included in the export. This helps ensure that only eligible and relevant relations are delivered to consuming systems.

What’s Changed

Relations Are Grouped by Relation Type

Instead of handling related products as a single collection, the export now organizes relations into dedicated groups based on their relation type.

Supported groups include:

  • Alternatives
  • Services
  • Accessories
  • Consumables
  • Compatibles
  • Relations without a relation type (temporary transitional support)

The export preserves a consistent ordering of relation groups:

  1. Alternatives
  2. Services
  3. Accessories
  4. Consumables
  5. Compatibles
  6. Relations without a relation type

Support for Transitional Data

As typification coverage is still being completed, the export supports both typified and non-typified relations.

Relations without a relation type continue to be exported during the transition period, ensuring continuity for existing integrations.

Relations marked as Invalid are excluded from export.

Smarter Relation Filtering

Before related products are exported, they pass through a filtering pipeline that evaluates whether each relation is eligible for export.

The filtering process includes:

  • End-of-life (EOL) filtering
  • Catalog-based filtering
  • Export limit filtering

The filtering order is applied consistently across all requests to ensure predictable results.

End-of-Life Product Filtering

Related products that have passed their End-of-Life date are automatically excluded from export.

The filtering logic evaluates locale-specific EOL dates and falls back to INT content when required.

This helps prevent discontinued products from appearing in related product recommendations.

Catalog-Based Filtering

For selected users participating in distributor catalog filtering, only related products that exist within the assigned distributor catalog are exported.

If a related product is not available in the applicable catalog, it is excluded from the export.

Per-Type Export Limits

Export limits are now applied independently for each relation type group.

By default, up to 500 related products can be exported per relation type. The limit can be customized using the relations_limit query parameter available in Product XML requests. 

Configuring Relation Export Limits

The maximum number of related products exported per relation type can be controlled with the relations_limit query parameter.

If the parameter is not specified, the default limit of 500 related products per relation type is applied.

Examples:

  • XML S3 Service
https://data.icecat.biz/xml_s3/xml_server3.cgi?lang=EN&icecat_id=122989465&output=productxml&relations_limit=50

This request returns up to 50 related products per relation type.

  • XML Service
https://data.icecat.biz/export/freexml/EN/122989465.xml?relations_limit=10

This request returns up to 10 related products per relation type.

The limit is applied independently to each relation type group after all filtering rules have been executed. If more relations are available than the specified limit, only the highest-ranked relations are included in the export.

Benefits

This enhancement improves the quality and relevance of related product data delivered through Product XML by:

  • Providing a structured export format grouped by relation type.
  • Reducing noise from invalid, discontinued, or inaccessible relations.
  • Supporting partner-specific filtering scenarios.
  • Delivering more consistent results across Icecat channels and export endpoints.
  • Maintaining compatibility during the ongoing relation typification rollout.

Availability

The updated related products export is available via Product XML and automatically applies to all supported Product XML requests.

Improved Accuracy of Described Product Statistics in Icecat.biz Matching

We have improved the calculation of the described product statistics displayed in Icecat.biz Matching.

The update ensures greater consistency between matching statistics and the actual products available through matching outputs and related exports.

What’s Changed

The calculation of the described products has been refined to align with the actual product quality assigned to matched products.

A product is now considered described only when:

  • The product is successfully matched.
  • Product quality is classified as Icecat or Supplier.

Unmatched products and products at other quality levels are excluded from the product statistics described.

User Experience Improvements

Matching results now provide a more reliable count of described products, helping users better understand the quality and coverage of their matched catalog.

The Unique described products statistic displayed in the matching results has also been simplified to show only the product count.

Benefits

These improvements reduce confusion when comparing matching statistics with generated output files and provide a more accurate representation of catalog enrichment coverage.

Users can make decisions based on statistics that more closely reflect the actual matching results.

AI Crawler Identification and Access Policy Update

Icecat continuously monitors automated traffic accessing its content. As AI-powered search engines and large language models become increasingly important sources of Icecat platform discovery, understanding how automated crawlers interact with Icecat content is essential.

To support informed access management decisions, Icecat conducted a comprehensive analysis of logs to identify AI-related crawlers, classify their purpose, and update crawler access policies accordingly.

Why This Matters

The objective of this initiative is to establish a transparent and controlled approach to AI crawler access by distinguishing between training crawlers and search-oriented crawlers.

This allows Icecat to:

  • Better understand how AI-related services access Icecat content.
  • Apply differentiated access policies based on the crawler’s purpose.
  • Support compliance with Icecat’s content usage and Fair Use policies.
  • Maintain visibility of Icecat content across AI-powered search and discovery platforms.

What Was Done

AI Crawler Identification

Logs were analyzed to identify automated traffic generated by AI-related services.

Detected crawlers were classified into two categories:

  • Training crawlers
  • Retrieval and search crawlers

The analysis also included measurements of request volume to better understand crawler activity and to prioritize access policy decisions.

Training Crawlers

The following crawler categories were identified as AI training or dataset collection crawlers and are now subject to blocking policies:

  • GPTBot
  • CCBot
  • Google-Extended
  • anthropic-ai
  • ClaudeBot
  • Bytespider
  • Applebot-Extended
  • Omgilibot
  • PetalBot
  • Diffbot
  • magpie-crawler
  • cohere-training-data-crawler
  • AI2Bot
  • Amazonbot
  • FacebookBot
  • meta-externalads
  • meta-externalagent
  • DataForSeoBot
  • Brightbot

Retrieval and Search Crawlers

The following crawlers were classified as search and retrieval crawlers and remain allowed:

  • ChatGPT-User
  • OAI-SearchBot
  • PerplexityBot
  • Googlebot
  • Bingbot
  • Applebot
  • DuckDuckBot
  • YouBot
  • PhindBot

These crawlers help users discover Icecat content through traditional search engines and AI-powered search experiences.

robots.txt Updates

Based on the crawler classification results, Icecat updated its robots.txt configuration to reflect the approved access policy.

The update included:

  • Restricting access for confirmed training crawlers.
  • Preserving all existing robots.txt directives.

Additional Protection Measures

Some crawlers are known to ignore robots.txt directives.

For these cases, additional infrastructure-level protection measures may be required, including firewall or WAF rules.

This applies particularly to Bytespider. This protection complements robots.txt and helps enforce crawler access policies more effectively.

Continuous Monitoring

Crawler ecosystems evolve rapidly, and new crawler identities regularly appear.

During the investigation, additional crawler identifiers were discovered after previous access rules had already been applied, demonstrating the importance of continuous monitoring and periodic review of crawler classifications.

Icecat will continue monitoring crawler activity and updating access policies when new AI-related crawlers emerge or existing crawler behavior changes.

Automated Inactivity Notifications for Shop Users

Icecat has introduced automated inactivity notifications for Channel partners as part of the Churn Signals initiative.

The new functionality helps identify inactive users and automatically encourages them to return to the platform through targeted email reminders. By proactively reaching out to disengaged users, Icecat can improve user retention and provide account managers with better visibility into potentially at-risk accounts.

Why This Matters

User inactivity is often an early indicator of churn.

By automatically notifying users when they become inactive, Icecat can:

  • Encourage users to return to the platform.
  • Improve customer retention.
  • Increase awareness of available Icecat services and product data.
  • Support proactive customer success activities.
  • Provide a scalable framework for future user engagement initiatives.

How It Works

Activity-Based User Statuses

The notification process is integrated with Icecat’s user activity monitoring system.

Users progress through activity-based statuses such as:

  • Onboarding
  • Active
  • Inactive
  • Reactivated
  • Churned

In this release, inactivity notifications are triggered only for users who reach the Inactive status.

Onboarding Protection

Newly registered users are not contacted immediately.

Users remain in the Onboarding stage during their initial onboarding period and do not receive inactivity reminders during this time. This prevents unnecessary notifications while users are still becoming familiar with the platform.

Automatic Inactivity Detection

A user becomes eligible for an inactivity reminder when:

  • The onboarding period has ended.
  • The user reaches the Inactive status.
  • No qualifying activity has been recorded for at least 7 days.

Once these conditions are met, the notification process runs automatically without requiring manual intervention.

Subscription Preference Support

Before sending a notification, Icecat verifies the user’s email subscription preferences.

Users who have opted out of email communications do not receive inactivity reminders, while those who remain subscribed continue to receive notifications.

Localized Communication

Notifications are delivered in the user’s preferred language whenever available.

If a preferred language version is unavailable, the system automatically falls back to English. This ensures a consistent experience for users across supported locales.

Reactivation Tracking

The system continuously monitors user activity after a notification is sent.

When a user returns and resumes activity:

  • The user is marked as Reactivated.
  • The current inactivity cycle is closed.
  • No additional inactivity reminders are sent for that cycle.

If the user becomes inactive again in the future, a new inactivity cycle begins, and a new reminder may be sent.

Current Scope

This release focuses exclusively on Channel partners.

Support for additional user groups may be introduced in future phases as the Churn Signals initiative evolves.

Benefits

The automated inactivity notification framework provides:

  • Early identification of disengaged users.
  • Automated re-engagement opportunities.
  • Respect for user communication preferences.
  • Multi-language support.
  • Scalable and configurable retention workflows.
  • Improved visibility into user engagement trends.

By combining activity monitoring with automated communication, Icecat can proactively support user engagement and reduce the risk of customer churn.

Expanded Product Coverage Through Common Brand Mappings

To improve product-matching coverage across imports and matching processes, a set of distributor-specific brand mappings has been consolidated into common brand mappings.

This change allows the same brand resolution logic to be reused across multiple distributors rather than being limited to a single import source.

What’s Changed

Qualified distributor-specific brand mappings have been converted into common mappings.

As a result:

  • Brand resolutions are now shared across multiple import sources.
  • Matching rules can be reused more broadly.
  • Products previously dependent on distributor-specific mappings may now be matched in additional scenarios.

Duplicate mapping rules created by the promotion process have been automatically cleaned up to ensure a consistent mapping structure.

Benefits

By making selected mappings available globally, Icecat can:

  • Improve matching coverage.
  • Reduce maintenance effort.
  • Increase consistency across distributor imports.
  • Improve product discovery and matching outcomes for users.

This enhancement helps ensure that successful brand resolutions benefit the wider ecosystem rather than remaining limited to a single distributor.

Improved File Naming for Coverage Reports

Coverage reports generated through the Coverage from File tool now include the name of the originally uploaded source file in the generated report name.

This improvement makes it easier to identify and organize exported reports, especially when working with multiple files and recurring coverage analyses.

What’s Changed

Previously, generated reports used technical file names, making it difficult to identify the source file that had been processed.

Report names now follow a more descriptive format:

<source_filename>_coverage_report_YYYY_MM_DD_hh_mm_ss

The original uploaded file name is included in both the downloaded reports and the reports delivered by email.

Additional Validation

To ensure compatibility and reliability, report names are automatically validated:

  • Unsupported characters are removed.
  • Excessively long names are shortened when necessary.
  • Uploaded file extensions are removed before processing.
  • Fallback naming is applied when no valid source file name is available.

Benefits

This enhancement improves report traceability and reduces the time required to locate reports associated with specific uploads.

Users can now immediately identify which source file was used to generate a particular coverage report.

Other Developments in Release 252: Behind-the-Scenes Improvements

As part of Release 252, Icecat delivered a series of technical debt-reduction and maintenance initiatives to improve platform stability, performance, scalability, and long-term maintainability.

While these improvements are largely invisible to end users, they help ensure a more reliable experience and provide a stronger foundation for future product development.

Performance Improvements

Several backend processes have been optimized to improve processing efficiency and reduce the time required for data updates and content delivery.

These improvements help:

  • Accelerate internal data processing workflows.
  • Reduce delays in content availability.
  • Improve overall platform responsiveness.
  • Support growing data volumes more efficiently.

Reliability Enhancements

Multiple maintenance activities aimed at improving the reliability of data processing and synchronization across Icecat services.

As a result:

  • Product information updates are propagated more consistently.
  • Data processing workflows are more resilient to temporary disruptions.
  • Internal monitoring and validation capabilities have been strengthened.
  • Platform operations are more predictable and stable.

API Improvements

Several API-related enhancements were introduced to improve scalability and ensure consistent behavior across services.

These changes help maintain reliable performance as usage continues to grow and make future API development easier and more sustainable.

Front-End Modernization

The front-end codebase received several maintenance improvements aimed at reducing technical complexity and increasing consistency.

Benefits include:

  • Improved maintainability of user interfaces.
  • More consistent implementation patterns.
  • Easier future enhancements.
  • Reduced long-term maintenance effort.

Infrastructure and Platform Maintenance

Ongoing platform maintenance activities were completed to improve the overall health of the Icecat ecosystem.

These initiatives strengthen the underlying platform by:

  • Increasing operational stability.
  • Improving scalability.
  • Reducing technical complexity.
  • Supporting future platform evolution.

Continuous Quality Improvements

Additional validation, monitoring, and operational improvements were implemented to further enhance platform quality and reliability.

These efforts help Icecat identify potential issues earlier and maintain a high level of service quality as the platform continues to evolve.

Benefits for Users

Although most of these changes operate behind the scenes, they contribute directly to:

  • Improved platform stability.
  • Faster and more reliable data processing.
  • Better scalability for future growth.
  • Increased service reliability.
  • A stronger foundation for future feature development.

Icecat remains committed to continuous investment in platform quality, ensuring customers benefit from a stable, scalable, and reliable product experience.

Summary

In Release 252, Icecat focused on delivering more accurate data, greater transparency, and a stronger platform foundation. Customers benefit from enhanced related-product exports, more reliable matching statistics, improved reporting capabilities, better coverage management, and automated user-engagement workflows. At the same time, ongoing investments in performance, reliability, and maintainability help ensure a stable and scalable platform that can continue to support future growth and innovation.

Want to get more value from Related Products?

Release 252 introduces new capabilities that allow related products to be filtered by assigned distributor catalogs, helping to deliver more relevant recommendations and product relationships. If you would like to explore how these capabilities can be configured for your organization, please contact your Icecat Account Manager. 

manual thumbnail3

Manual for Icecat Live: Real-Time Product Data in Your App

Icecat Live is a (free) service that enables you to insert real-time produc...
 June 10, 2022
Icecat CSV Interface
 September 28, 2016
manual thumbnail
 September 17, 2018

Icecat Add-Ons Overview. NEW: Claude AI, ChatGPT, AgenticFlow.AI, Mindpal.space and BoltAI

Icecat has a huge list of integration partners, making it easy for clients ...
 September 3, 2025
LIVE JS

How to Create a Button that Opens Video in a Modal Window

Recently, our Icecat Live JavaScript interface was updated with two new fun...
 November 3, 2021
 January 20, 2020
New Standard video thumbnail

Autheos video acquisition completed

July 21, Icecat and Autheos jointly a...
 September 7, 2021
Manual How to Import Free Product Content Into Your Webshop via Icecat

Manual: How to Import Free Product Content Into Your E-commerce System via Icecat

This guide will quickly show you how to import free product content from Ic...
 May 24, 2024