Getting started
Exploring and using data
Exploring catalogs and datasets
Exploring a catalog of datasets
What's in a dataset
Filtering data within a dataset
An introduction to the Explore API
An introduction to the Automation API
Introduction to the WFS API
Downloading a dataset
Search your data with AI (vector search)
Creating maps and charts
Creating advanced charts with the Charts tool
Overview of the Maps interface
Configure your map
Manage your maps
Reorder and group layers in a map
Creating multi-layer maps
Share your map
Navigating maps made with the Maps interface
Rename and save a map
Creating pages with the Code editor
How to limit who can see your visualizations
Archiving a page
Managing a page's security
Creating a page with the Code editor
Content pages: ideas, tips & resources
How to insert internal links on a page or create a table of contents
Sharing and embedding a content page
How to troubleshoot maps that are not loading correctly
Creating content with Studio
Creating content with Studio
Adding a page
Publishing a page
Editing the page layout
Configuring blocks
Previewing a page
Adding text
Adding a chart
Adding an image block to a Studio page
Adding a map block in Studio
Adding a choropleth map block in Studio
Adding a points of interest map block in Studio
Adding a key performance indicator (KPI)
Configuring page information
Using filters to enhance your pages
Refining data
Managing page access
How to edit the url of a Studio page
Embedding a Studio page in a CMS
Visualizations
Managing saved visualizations
Configuring the calendar visualization
The basics of dataset visualizations
Configuring the images visualization
Configuring the custom view
Configuring the table visualization
Configuring the map visualization
Understanding automatic clustering in maps
Configuring the analyze visualization
Publishing data
Publishing datasets
Creating a dataset
Creating a dataset from a local file
Creating a dataset with multiple files
Creating a dataset from a remote source (URL, API, FTP)
Creating a dataset using dedicated connectors
Creating a dataset with media files
Federating an Opendatasoft dataset
Publishing a dataset
Publishing data from a CSV file
Publishing data in JSON format
Supported file formats
Promote mobility data thanks to GTFS and other formats
What is updated when publishing a remote file?
Configuring datasets
Automated removal of records
Configuring dataset export
Checking dataset history
Configuring the tooltip
Dataset actions and statuses
Dataset limits
Defining a dataset schema
How Opendatasoft manages dates
How and where Opendatasoft handles timezones
How to find your workspace's IP address
Keeping data up to date
Processing data
Translating a dataset
How to configure an HTTP connection to the France Travail API
Deciding what license is best for your dataset
Types of source files
OpenStreetMap files
Shapefiles
JSON files
XML files
Spreadsheet files
RDF files
CSV files
MapInfo files
GeoJSON files
KML/KMZ files
GeoPackage
Connectors
Saving and sharing connections
Airtable connector
Amazon S3 connector
ArcGIS connector
Azure Blob storage connector
Database connectors
Dataset of datasets (workspace) connector
Eco Counter connector
Feed connector
Google BigQuery connector
Google Drive connector
How to find the Open Agenda API Key and the Open Agenda URL
JCDecaux connector
Netatmo connector
OpenAgenda connector
Realtime connector
Salesforce connector
SharePoint connector
U.S. Census connector
WFS connector
Databricks connector
Connecteur Waze
Harvesters
Harvesting a catalog
ArcGIS harvester
ArcGIS Hub Portals harvester
CKAN harvester
CSW harvester
FTP with meta CSV harvester
Opendatasoft Federation harvester
Quandl harvester
Socrata harvester
data.gouv.fr harvester
data.json harvester
Processors
What is a processor and how to use one
Add a field processor
Compute geo distance processor
Concatenate text processor
Convert degrees processor
Copy a field processor
Correct geo shape processor
Create geo point processor
Decode HTML entities processor
Decode a Google polyline processor
Deduplicate multivalued fields processor
Delete record processor
Expand JSON array processor
Expand multivalued field processor
Expression processor
Extract HTML processor
Extract URLs processor
Extract bit range processor
Extract from JSON processor
Extract text processor
File processor
GeoHash to GeoJSON processor
GeoJoin processor
Geocode with ArcGIS processor
Geocode with BAN processor (France)
Geocode with PDOK processor
Geocode with the Census Bureau processor (United States)
Geomasking processor
Get coordinates from a three-word address processor
IP address to geo Coordinates processor
JSON array to multivalued processor
Join datasets processor
Meta expression processor
Nominatim geocoder processor
Normalize Projection Reference processor
Normalize URL processor
Normalize Unicode values processor
Normalize date processor
Polygon filtering processor
Replace text processor
Replace via regular expression processor
Retrieve Administrative Divisions processor
Set timezone processor
Simplify Geo Shape processor
Skip records processor
Split text processor
Transform boolean columns to multivalued field processor
Transpose columns to rows processor
WKT and WKB to GeoJson processor
what3words processor
Data Collection Form
About the Data Collection Form feature
Data Collection Forms associated with your Opendatasoft workspace
Create and manage your data collection forms
Sharing and moderating your data collection forms
Dataset metadata
Analyzing how your data is used
Getting involved: Sharing, Reusing and Reacting
Discovering & submitting data reuses
Sharing through social networks
Commenting via Disqus
Submitting feedback
Following dataset updates
Sharing and embedding data visualizations
Monitoring usage
An overview of monitoring your workspaces
Analyzing user activity
Analyzing actions
Detail about specific fields in the ods-api-monitoring dataset
How to count a dataset's downloads over a specific period
Analyzing data usage
Analyzing a single dataset with its monitoring dashboard
Analyzing back office activity
Using the data lineage feature
Managing your users
Managing limits
Managing users
Managing users
Setting quotas for individual users
Managing access requests
Inviting users to the portal
Managing workspaces
Managing your portal
Configuring your portal
Configure catalog and dataset pages
Configuring a shared catalog
Sharing, reusing, communicating
Customizing your workspace's URL
Managing legal information
Connect Google Analytics (GA4)
Regional settings
Pictograms reference
Managing tracking
Look & Feel
Branding your portal
Customizing portal themes
How to customize my portal according to the current language
Managing the dataset themes
Configuring data visualizations
Configuring the navigation
Adding IGN basemaps
Adding images and fonts
Plans and quotas
Managing security
Configuring your portal's overall security policies
A dataset's Security tab
Mapping your directory to groups in Opendatasoft (with SSO)
Single sign-on with OpenID Connect
Single sign-on with SAML
Parameters
- Home
- Publishing data
- Publishing datasets
- Creating a dataset from a remote source (URL, API, FTP)
Creating a dataset from a remote source (URL, API, FTP)
Updated by Patrick Smith
As a source of data for a dataset, you can add a file from your computer, a URL (a remote server or API), or an FTP server (using the FTP, FTPS, or SFTP protocol).
For more information on compressed or uncompressed file formats, see Supported file formats.
Uploading a file from a URL (remote server or API)
You can connect the platform to:
- A remote server via its URL, to import files stored there
- A remote source that exposes data records over an API
Opendatasoft supports HTTP and HTTPS URLs to files, for example "http://example.org/mydata.csv".
Opendatasoft supports the following authenticated connection methods: login/password, API key, OAuth2 protocol (client_credentials grant type) and supplying info within an HTTP header.
- In Catalog > Datasets, click on the New dataset button
- In the wizard that opens, under the Retrieve a file section, select From a URL
- Configure your HTTP connection
- From the preview of the first 20 records that appears, configure the source
- Configure the dataset information or use the prefilled values:
- In the Dataset name field, enter the title for this dataset
- In the Dataset technical identifier field, enter a meaningful identifier for this dataset
- If you want anyone with access to your workspace to be able to explore the dataset, toggle off Access restricted to allowed users and groups
- Be of REST type and preferably in JSON, with a "GET" method.
- It must be available via the internet.
- It must not be paginated or incremental, i.e. results must be obtained in a single call.
- It must be accessible by the Opendatasoft platform via simple authentication (permanent API key, fixed HTTP header, etc.).
Uploading a file from an FTP server
Opendatasoft supports FTP, FTPS, or SFTP URLs to:
- Files, for example: "ftp://example.org/my_dir/mydata.csv"
- Folders, for example: "ftp://example.org/my_dir/"
In Catalog > Datasets, click on the New dataset button
- In the wizard that opens, under the Retrieve a file section, select From an FTP server
- Configure your connection
Regarding SSH certificate configuration:
- paste the entire private key file in Private Key field
- the passphrase is relative to the private key and is optional
- From the preview of the first 20 records that appears, configure the source
- Configure the dataset information or use the prefilled values:
- In the Dataset name field, enter the title for this dataset
- In the Dataset technical identifier field, enter a meaningful identifier for this dataset
- If you want anyone with access to your workspace to be able to explore the dataset, toggle off Access restricted to allowed users and groups
After creating a dataset, an interface for that dataset opens. Only users with the right permissions, either "Create dataset" or "Edit dataset", can use this interface. There you can process the data, configure the datasets and their visualizations, and publish the datasets.
If you update your source file and republish, the entire file will be loaded. However, if the source is a folder and not a file, Opendatasoft will take into account only the newly uploaded files within that folder.
If you delete a file from the FTP folder, you need to perform a small piece of upkeep. To the right of the resource, click on Clean cache before republishing, or else the change will not be reflected in the related dataset. For more information about FTP folders, please read this section about sourcing multiple files stored on an FTP server.
Creating a dataset using dedicated connectors
You can create datasets based on data from remote services for which we have created dedicated connectors.
For the list of available connectors, see here. Some connectors are only available on-demand and may be subject to pricing.