Manual: How to Retrieve Export Files

By
How to Retrieve Export Files

This guide to retrieve export files is designed to assist our valued partners in downloading our files, particularly those of significant size. If you typically download files through your browser, we’ve implemented an e-tag to facilitate the automatic initiation of partial downloads. In this scenario, no additional steps are required. However, if you are a user who employs terminal or command prompt tools, please adhere to the following instructions.

Generating the Link for Retrieval

https://<USERNAME>:<PASSWORD>@data.icecat.biz/export/freexml/refs/FeaturesList.xml.gz
https://data.icecat.biz/export/freexml/refs/FeaturesList.xml.gzLink of the file.
https://Secure protocol
freexmlSelect your folder depending on Icecat subscription:
– freexml for Open,
– level4 for Full.
<USERNAME>:<PASSWORD>@an option to include username and password into URL. Doesn’t work on PowerShell

Navigation Within Terminal

mkdir NewFoldercreate new folder
cd NewFolderenter folder
rmdir NewFolderdelete folder (must be empty)
rm NewFile.xmldelete a file
rm *delete everything in a folder
cd ..go to parent folder

Windows PowerShell

1. Open the Search on Windows, and search for PowerShell. For sophisticated scripts it is recommended to use Visual Studio Code. Save your script as <PowerShellScript>.ps1.

2. Enable Basic Authentication:

$username = '<USERNAME>’
$password = ‘<PASSWORD>’
$securePassword = ConvertTo-SecureString $password -AsPlainText -Force
$credentials = New-Object System.Management.Automation.PSCredential($username, $securePassword)

3. Now your credentials are stored as a token in $credentials variable.

4. Parameters:

-MethodHTTP method, for downloading it is GET
-Credentialway to send your login and password
-OutFilesave the response into the file
-Headersspecify the custom headers. Useful for Content Tokens
-Resumeif -OutFile is specified, tries to resume downloading on connection drop.

Examples:

# Example with Basic Auth
$username = "<USERNAME>"
$password = "<PASWORD>"
$url = 'https://data.icecat.biz/export/freexml/refs/FeaturesList.xml.gz'
$outputFile = "FeaturesList.xml.gz"
$securePassword = ConvertTo-SecureString $password -AsPlainText -Force
$credentials = New-Object System.Management.Automation.PSCredential($username, $securePassword)

Invoke-WebRequest -Uri $url -Method GET -Credential $credentials -OutFile $outputFile -Resume  
# Example with headers
$url = 'https://data.icecat.biz/export/freexml/refs/FeaturesList.xml.gz'
$outputFile = "FeaturesList.xml.gz"
$headers = @{
    "Api-token" = "<API_TOKEN>"
}

Invoke-WebRequest $url -Method GET -OutFile $outputFile -UseBasicParsing -Headers $headers -Resume

Source: https://learn.microsoft.com/en-us/powershell/module/microsoft.powershell.utility/invoke-webrequest?view=powershell-7.4

GitBash

curl is pre-installed on GitBash. Navigate to curl section of the manual.

Beware that compressed XML file might return weird-looking output in your GItBash. Consider adding -o <FILE_NAME> to hide the log mess.

Ubuntu

curl

1. curl is pre-installed on Linux OS and GitBash, but you may check its presence:

sudo apt-get install curl
curl --version

2. Include your username :

https://<USERNAME>:<PASSWORD>@data.icecat.biz/File.xml.gz
https://data.icecat.biz/File.xml.gz -u <USERNAME>:<PASSWORD>

3. Other parameters:

-C <BYTES_TO_SKIP>continue on connection drop, use -C – to continue from any place.
-u <USERNAME:PASSWORD>Basic Auth.
-o <FILE_NAME>save file with a different name. Highly recommended for GitBash.
-H <NAME: VALUE>add custom header to request. Useful for Content Tokens.
-v/-vv/-vvvenable verbose (detailed information). The more v after dash, the more info.
-ssilent, do not show errors and progress bar.
-X GETuse explicit method.
–connect-timeout 1000timeout on connection, 0 by default.
Add parameters after the URL.

Examples:

# Simple silent request with basic auth
curl "https://data.icecat.biz/export/freexml/refs/FeaturesList.xml.gz" -s -u <USERNAME>:<PASSWORD> -C -

# Request with Api-token
curl "https://data.icecat.biz/export/freexml/refs/FeaturesList.xml.gz" -C - -H "Api-token: <API-TOKEN>"

# Download to Features.xml.gz
curl "https://data.icecat.biz/export/freexml/refs/FeaturesList.xml.gz" -u <USERNAME>:<PASSWORD> -C - -O "Features.xml.gz"

Source: https://quickref.me/curl

wGet

1. wGet is pre-installed on Linux OS, but you may check its presence:

sudo apt-get install wget
wget --version

2. Include the username and password to the link with one of two methods:

https://<USERNAME>:<PASSWORD>@data.icecat.biz/File.xml.gz
https://data.icecat.biz/File.xml.gz -username <USERNAME> -password <PASSWORD>

3. Other parameters:

–usernameyour user name for Basic Auth.
–passwordyour password for Basic Auth.
–header=<NAME:VALUE>set the custom header, might be useful for Content Tokens.
-c/–continuecontinue downloading on connection drop.
-O/–output-file=<FILE_NAME>save file with a different name.
-t/–tries=<RETRIES>set number of retries.
-T/–timeout=<MILISECONDS>set all timeout values.
-r/–recursivespecify recursive download (get the page and everything linked to it).
-d/–debugprint lots of debugging information.
-q/–quietquiet (no output).
-v/ –verboseverbose (detailed info), enabled by default.
All parameters should be included before the URL.

Examples:

# Short syntax
wget -d -t 30 -O "FeaturesList.xml" https://valera-shop:mv3CmPjGEXVTHS3@data.icecat.biz/export/freexml/refs/FeaturesList.xml.gz

# Long syntax
wget --continue --user="<USERNAME>" --password="<PASSWORD>" --output-file="FeaturesList.xml" --recursive --quiet --timeout=1000000 https://data.icecat.biz/export/freexml/refs/FeaturesList.xml.gz

# Example with api-token
wget -q --header="Api-token: <API-TOKEN>" https://data.icecat.biz/export/freexml/refs/FeaturesList.xml.gz

Source: https://gist.github.com/antonydevanchi/b968f61a62e3b6ed711a6d7889aae084

If you still have any questions, feel free to reach out to us via email at support@icecat.biz.

Icecat xml

Open Catalog Interface (OCI): Manual for Open Icecat XML and Full Icecat XML

This document describes the Icecat XML method of Icecat's Open Catalog Inte...
 November 3, 2019
Manual

Manual for Icecat Live: Real-Time Product Data in Your App

Icecat Live is a (free) service that enables you to insert real-time produc...
 June 10, 2022
Manual for Icecat CSV Interface

Manual for Icecat CSV Interface

This document describes the manual for Icecat CSV interface (Comma-Separate...
 September 28, 2016
 October 4, 2018
LIVE JS

How to Create a Button that Opens Video in a Modal Window

Recently, our Icecat Live JavaScript interface was updated with two new fun...
 November 3, 2021
Addons plugins

Icecat Add-Ons Overview. NEW: Red Technology

Icecat has a huge list of integration partners, making it easy for clients ...
 October 27, 2023
Manual

Manual for Open Icecat JSON Product Requests

JSON (JavaScript Object Notation) is an increasingly popular means of trans...
 September 17, 2018
 January 20, 2020
New Standard video thumbnail

Autheos video acquisition completed

July 21, Icecat and Autheos jointly a...
 September 7, 2021
Manual

Manual Personalized Interface File and Catalog from Icecat

With Icecat, you can generate personalized or customized CSV or Excel files...
 May 3, 2022