Skip to content

Updates

SourceStack is proud to maintain a comprehensive account of its customer-facing updates.

Not finding a feature you're looking for? Email us: requests@sourcestack.co.


Versions

4.11.9 - August 8, 2022

  • Improved data coverage of the company_url, linkedin_url, education, seniority, and hours fields in the /jobs dataset
  • Expanded the breadth of the /jobs dataset
  • Added Trainee, Commission, and Student as possible hours values

4.11.8 - August 3, 2022

  • Fixed a bug that affected Advanced Filtering Queries with the operator CONTAINS_ALL or CONTAINS_ANY and a single item value

4.11.7 - August 1, 2022

  • Added the following categories - Huntin & Fishin, Computer Networking, Research, RetailTech, SalesTech, Videos, Shipping & Delivery, Network Infrastructure
  • Renamed the category Oil & Energy to Oil & Gas
  • Expanded data coverage of the following categories - Local Services, MarTech, CleanTech, Renewables, Solar Energy, Wind Energy

4.11.6 - July 28, 2022

  • Fixed a bug that caused comma delimited inputs with one or more empty strings mixed in them to be rejected
  • Fixed a bug that caused very long urls input values to return a 502 status_code

4.11.5 - July 25, 2022

4.11.4 - July 23, 2022

  • Added the Notarization category of Products
  • Expanded coverage of the eSignature, Contract Management, Returns, and SMS Marketing categories of Products

4.11.3 - July 20, 2022

  • Improved the standardization of the company_name and title fields across all datasets
  • Slightly expanded the breadth of the /companies dataset

4.11.2 - July 18, 2022

  • Added custom error handling for unsupported Advanced Filtering Operators used in combination with a datetime_str column
  • Fixed a bug that would cause certain fields types to be incorrectly rejected

4.11.1 - July 16, 2022

  • Slightly expanded the breadth of the /jobs dataset (though the overall number of job posts tracked has declined slightly as tech companies tracked have slowed their hiring)
  • Fixed a bug that would cause requests with a response size between 6 MB and 6 MiB specifically to fail
  • Fixed a bug that caused requests that had timed out to return the wrong error code

4.11.0 - June 30, 2022

4.10.5 - June 26, 2022

  • Fixed a bug that caused the confirmation email for new customers to not be sent

4.10.4 - June 23, 2022

  • Expanded coverage of the Affiliate Management, Video Analytics, AV Player, and Session Recording categories of Products
  • Added the Contract Management category of Products
  • Updated some Products which had been acquired or reorganized to reflect new ownership

4.10.3 - June 19, 2022

  • Fixed a bug that caused some malformed Advanced Filtering requests to return status_code 500 instead of 422
  • Fixed a bug that caused commas in numerical Advanced Filtering values to throw an error in some circumstances
  • Improved the SourceStack webapp's tolerance for malformed Advanced Filtering value arrays

4.10.2 - June 8, 2022

  • Added support for completely random ordering of results - order_by=RANDOM

4.10.1 - May 26, 2022

  • Fixed a bug that could cause duplicates in the /skus dataset if the store domain changed after the first_indexed date

4.10.0 - May 24, 2022

  • Added support for CONTAINS_ANY, NOT_CONTAINS_ANY, CONTAINS_ALL, NOT_CONTAINS_ALL operators for Advanced Filtering queries
  • The CONTAINS and NOT_CONTAINS operators are now deprecated - requesting them will fallback to CONTAINS_ANY and NOT_CONTAINS_ANY respectively (the behavior is the same)
  • Updated the SourceStack webapp user interface to better accommodate large queries

4.9.6 - May 22, 2022

  • Slightly expanded the breadth of the /companies dataset
  • Slightly expanded the breadth of the /skus dataset

4.9.5 - May 21, 2022

  • Added Talent Management, Branding, Copywriting, Web Optimization, Performance Marketing, Tutoring, and Media Services categories of companies
  • Expanded data coverage of dozens of existing categories of companies
  • Slightly improved data coverage of the country field in the /companies dataset

4.9.4 - May 18, 2022

  • Expanded coverage of the Helpdesk, Call Tracking, Call Center Tools categories of Products
  • Improved the error handling for Advanced Filtering queries with malformed IN and NOT_IN filter values
  • Improved the error handling for API queries with malformed datetime string search_param values
  • Improved the error handling for API queries with too many values in a non filters search_param

4.9.3 - May 16, 2022

  • Added multi-filter support for Query Bookmarking of Advanced Filtering queries in the SourceStack webapp
  • Improved the error handling for API queries with more than one search_param

4.9.2 - May 15, 2022

  • Slightly expanded the breadth of the /skus dataset
  • Slightly expanded the breadth of the /jobs dataset
  • Slightly improved data coverage of the company_url field in the /jobs dataset

4.9.1 - May 10, 2022

  • Substantially expanded the breadth of the /skus dataset

4.9.0 - May 3, 2022

  • Added the following fields to the /skus dataset - store_first_indexed, store_last_indexed, is_active, sku_rank
  • Substantially expanded the breadth of the /skus dataset
  • Substantially improved the latency of url-specific queries to the /skus dataset (exact=False only)

4.8.1 - April 30, 2022

  • Substantially improved the latency of url-specific queries to the /companies dataset

4.8.0 - April 28, 2022

  • Added the following aggregated job post fields to the /companies dataset - hiring_remotely, open_job_count, open_job_names, open_job_departments, open_job_educations, open_job_seniorities, open_job_tags_matched, open_job_tag_categories, all_countries
  • Added tranco_rank (Top 1 Million Sites) and domcop_rank (Top 10 Million Sites) fields to the /companies dataset
  • Improved data coverage of 18 fields in the /companies dataset

4.7.3 - April 26, 2022

  • Added the fields company_legal_name, currencies, board_platform to the /jobs database
  • Fixed a bug that caused the hero_image_url field to have worse-than-expected data coverage

4.7.2 - April 25, 2022

  • Substantially expanded coverage of Surveys category of Products
  • Improved the standardization of the values for the city field in the /companies and /jobs datasets
  • Slightly improved data coverage in the remote field in the /jobs dataset
  • Fixed a pair of small edge-case bugs that would rarely affect the formatting of values for the addresses field and most _url fields in the /companies dataset

4.7.1 - April 22, 2022

  • Updated the SourceStack Services Subscription Agreement, located at sourcestack.co/terms
  • Fixed a bug with the SourceStack webapp where empty query filters were not compatible with Query Bookmarking
  • Fixed a bug with the SourceStack webapp where the Credits Used counter didn't reset on subsequent queries with an incomplete search param/filter

4.7.0 - April 19, 2022

  • Added the ability to filter on - and retrieve data from - the job_full_text field in the /jobs dataset
  • Fixed a bug with the SourceStack webapp where the default fields placeholder would not update when switching endpoints in Advanced Filtering mode

4.6.0 - April 17, 2022

  • Slightly modified the logic for which entries are included in the companies dataset; count_only totals may be up to ±3% from pre-change totals
  • Fixed a bug with the /companies dataset where querying with url + exact would sometimes return no rows found (false negative)

4.5.8 - April 13, 2022

  • Substantially improved the breadth of the /jobs dataset
  • Slightly improved data coverage in the hours field in the /jobs dataset

4.5.7 - April 12, 2022

  • Fixed an enqueueing bug that caused some medium-size companies to not be indexed at all
  • Fixed a bug with the webapp Query Bookmarking that caused the endpoint for Advanced Filtering requests to not be set as intended

4.5.6 - April 9, 2022

  • Improved the true positive rate of status_code 310 and 410 sites (Holding Page) in the companies dataset
  • Added the Course Creation category of Products
  • Substantially expanded coverage of Podcasting category of Products

4.5.5 - April 8, 2022

  • Substantially improved data coverage in the company_url and remote fields in the /jobs dataset
  • Slightly improved data coverage in the company_name and logo_url fields in the /jobs dataset

4.5.4 - April 4, 2022

  • Improved API handling of misspelled fields and querystring params across every dataset and workflow
  • Fixed a bug that was causing the /quota API to temporarily be unavailable for customers

4.5.3 - March 31, 2022

  • Added support for Advanced Filtering conditions where array fields are or are not empty
    • For example: [{"field":"emails","operator":"EQUALS","value":"NULL"}]
  • Improved discoverability of the default fields in the webapp
  • Improved error message quick-link usability in the webapp
  • Fixed a bug with endpoints changing when toggling Advanced Filtering in the webapp

4.5.2 - March 27, 2022

  • Consolidated duplicate /products entries, where (e.g.) a now-acquired product was listed under both the original company and the acquirer
  • Expanded support for detecting General Analytics, Identity Verification Products
  • Added Privacy as a Service and Moderation as a Service categories of Products

4.5.1 - March 20, 2022

  • Substantially improved webapp query bookmarking - now fully dynamic
  • Improved webapp error handling

4.5.0 - March 16, 2022

  • Performance of many queries is now slightly faster
  • Queries with exact=False set will now tolerate optional internal spaces
    • For example, a query on the /products dataset of name=Big Query will correctly return the product BigQuery.

4.4.0 - March 10, 2022

  • Data in the /jobs dataset is now pre-enriched by matching records from the /companies dataset by default
  • The following fields now have substantially improved data coverage: logo_url, company_name, addresses, all_countries, linkedin_url, twitter_url, youtube_url, instagram_url, facebook_url, tiktok_url, pinterest_url, github_url, categories, phones, emails
  • The following fields have now been added (to the /jobs dataset): founded_year, founded_dt, company_description, contact_url, about_url, docs_url, keywords, alexa_rank, majestic_rank, umbrella_rank

4.3.7 - February 27, 2022

  • SourceStack now returns the status_code 402 when a user does not have sufficient credits for a given query
  • Advanced Filtering queries will now tolerate certain typos in the names of fields
  • The SourceStack API will now return a specific error when more than 1 search_param is provided

4.3.6 - February 18, 2022

  • Improved error handling of nonstandard API querystring inputs - for example, an integer in a boolean field
  • Improved error handling for requests that specify a nonstandard listing of fields
  • Updated the /fields docs to include exhaustive lists of the values for seniority and education for the /jobs dataset
  • Made several small copy and in-console logging changes to the SourceStack webapp to improve usability, per feedback from user testing

4.3.5 - February 12, 2022

  • Increased the daily rate limit for Startup and Scaling Tier customers from 300 to 500

4.3.4 - February 9, 2022

  • Improved data coverage in the hours field in the /jobs dataset

4.3.3 - February 2, 2022

  • Fixed a bug with the webapp that caused some categories= queries to incorrectly return 0 results
  • Fixed a bug with webapp query bookmarking that caused some urls to not default to the previous export option

4.3.2 - January 28, 2022

  • Fixed a bug that caused some /jobs entries to have their seniority be mis-categorized
  • Fixed a bug that caused some /jobs entries to have both city and region values in the city field

4.3.1 - January 18, 2022

  • Fixed a bug that could cause the /categories no-cost endpoint to inaccurately return 0 results (false negative)

4.3.0 - January 15, 2022

  • Added customized API and webapp error handling that suggests the closest field, operator, and/or query parameter(s) when the input is invalid

4.2.5 - January 11, 2022

  • Improved on-site search speed and result quality
  • Improved webapp compatibility with older browsers (Chrome 49+, Firefox 53+, etc)
  • Slightly improved data coverage in datetime fields (e.g. sku_published_at, sku_created_at, sku_updated_at)

4.2.4 - January 8, 2022

  • Fixed a parsing bug that caused some /jobs results to inaccurately not be labeled remote=True (false negative)
  • Fixed a minor bug affecting the endpoint saved by the query bookmarking feature in the SourceStack webapp for Advanced Filtering queries

4.2.3 - January 3, 2022

  • Fixed an enqueueing bug that was unintentionally limiting the breadth of the /jobs dataset

4.2.2 - December 27, 2021

  • Fixed an enqueueing bug that caused some companies to be indexed less frequently than intended
  • Added error handling for requests including duplicates in comma delimited urls - for example: url=domain1.com,domain2.com,domain1.com
  • Updates to the matching criteria for the categories Vegan & Vegetarian, Meat Alternatives, Milk Alternatives

4.2.1 - December 19, 2021

  • Substantially improved the breadth of the /jobs dataset

4.2.0 - December 8, 2021

  • Launched query bookmarking in the SourceStack webapp. Use the settings toggle to export the webapp or API url for sharing with others or saving the parameters for later

4.1.0 - November 14, 2021

  • Substantially improved the breadth of the /companies dataset

4.0.2 - November 11, 2021

  • The API will now more gracefully handle some search_params (like uses_product) passed as Fields in an Advanced Filtering Query
  • Updated the copy of 5 error messages provided by the SourceStack API to include specifics on impermissible param combinations and links to relevant documentation

4.0.1 - November 2, 2021

  • Fixed a bug that caused comma delimited values provided in an Advanced Filtering query to be unnecessarily rejected if the comma was not immediately followed by a space
  • The API will now more gracefully handle some non-standard search_params values, such as misspelled export values and malformed limit values

4.0.0 - October 12, 2021

  • BREAKING CHANGE: array type fields will no longer tolerate EQUALS queries in Advanced Filtering mode (use CONTAINS instead). We found it was a common cause of user error, and no customer has (as of yet) had a usecase that required exactly one value to be present in an array column. If your business requires this type of filtering, please contact your account representative

3.3.1 - October 8, 2021

  • Fixed a bug in the Sourcestack webapp where the status_code would not populate in the sidebar if a query was the first in the user's session and had failed
  • The API will now more gracefully handle malformed JSON passed in Advanced Filtering POST requests

3.3.0 - October 1, 2021

  • Substantially improved the SourceStack webapp's prefill functionality, including adding prefill support for Advanced Filtering
  • Improved the Add Filter functionality in the SourceStack webapp
  • Clarified the copy of some error messages in the SourceStack webapp

3.2.3 - September 29, 2021

  • Substantially improved coverage of startups in the /companies dataset

3.2.2 - September 24, 2021

  • Improved coverage of Subscription Billing products in the /products dataset
  • Added a handful of new /companies categories

3.2.1 - September 13, 2021

  • Fixed a bug that caused multiple duplicate emails to be sent during the onboarding process

3.2.0 - August 27, 2021

  • The cadence of customer-facing updates will be temporarily lower as we invest in backend optimization and observability. Thank you for your patience!

3.1.6 - August 21, 2021

  • Improved data coverage for the country field
  • Expanded the breadth of the /jobs dataset

3.1.5 - August 17, 2021

  • Expanded the breadth of the /jobs dataset
  • Slightly expanded the breadth of the /companies dataset
  • Slightly improved data coverage for the job_location, hours, department, and currencies fields across all datasets

3.1.4 - August 13, 2021

  • Updated the spelling/capitalization of several hundred SaaS /products - for example, Toutapp is now correctly ToutApp
  • Updated the parent company of 28 SaaS companies that have since been acquired
  • Improved the data coverage of the categories field in the /companies dataset
  • Fixed bugs that caused a small number of results in the company_name and emails fields to be mis-formatted

3.1.3 - August 9, 2021

  • Fixed a bug in the SourceStack webapp that caused the settings sidebar to become cropped after some queries
  • Improved the UX of using keyboard shortcuts with the SourceStack webapp (CMD+ENTER to send the query)
  • Clarified the copy of most of the options in the SourceStack webapp
  • Improved the false positive rate for data in the company_name field across datasets

3.1.2 - August 5, 2021

  • Fixed a bug that caused the SOURCESTACK-REQUEST-ID header to not be included in some status_code 422 responses
  • Standardized the response fields for requests with 0 rows found and export other than caller
  • Added clarification to the message text for requests with 0 rows found and exact=True
  • Added clarification to the message text for requests with count_only=True and export other than caller
  • Added clarification to the message text for requests with duplicate values in their fields param (ex: fields=url,company_name,url)
  • Added clarification to the message text for POST requests without the Content-Type application/json header

3.1.1 - August 2, 2021

  • Fixed a bug that caused logo_url to have non-standard formatting at times
  • Fixed a parsing bug that caused some inaccurate values for founded_year to be returned
  • Added the following /companies categories - Meat Alternatives, Milk Alternatives, Synthetic Biology

3.1.0 - July 29, 2021

  • Initial release of the following fields in the /companies dataset:
Endpoint Field Type Example
/companies status_url string status.example.com
/companies license_url string example.com/about/license/BSD
/companies referral_url string example.com/refer-a-friend
/companies twitch_url string twitch.tv/example
/companies vimeo_url string vimeo.com/123456
/companies discord_url string discord.gg/example
/companies whatsapp_url string wa.me/123456
/companies telegram_url string t.me/example
/companies news_urls array [example.com/news/series-a-raise, example.com/news/press-release]
/companies comparison_urls array [example.com/example-vs-competitor]
/companies integration_urls array [example.com/integrations/zapier]

3.0.0 - July 27, 2021

  • Initial release of the Advanced Filtering mode in the SourceStack webapp - contact your account representative for access
  • The following SourceStack API endpoints - /companies, /skus, /products, /jobs, /categories - now accept POST requests with the Content-Type: application/json header
  • The SourceStack queries Postman Collection now includes a dozen Advanced Filtering examples
  • After a significant refactor, queries to the /skus endpoint are now 62.3% faster, on average
  • Initial release for the /skus dataset of the following fields: [tld, company_name, company_categories, company_description, company_title, language, country, currencies, logo_url]
  • BREAKING CHANGE: Incompatible changes were made to some field names. They are as follows:
Endpoint Old New
/skus variant_skus variant_handles
/skus variant_highest_price highest_variant_price
/companies customers_urls customer_urls
/companies chrome_extension chrome_extension_url

2.8.15 - July 25, 2021

  • Slightly improved data coverage in datetime fields (e.g. sku_published_at, sku_created_at, sku_updated_at)
  • Improved the true positive rate of status_code 310 sites (Holding Page) in the companies dataset

2.8.14 - July 23, 2021

  • We are now reachable by phone! Call or text (415-212-9604) to talk with a member of our team
  • Slightly improved data coverage of all /companies and /jobs fields

2.8.13 - July 20, 2021

  • Significantly improved the data cleanliness in the addresses and company_name fields
  • Fixed a bug that was causing duplicate values to occasionally be present in queries to the /skus dataset
  • Fixed a bug that was causing sku_count and sku_vendor_count to be lower than expected in the /companies dataset

2.8.12 - July 16, 2021

  • Expanded the breadth of the jobs dataset
  • Slightly improved data coverage of all /companies fields
  • Added support for first_indexed in the /jobs dataset going back to March 2020

2.8.11 - July 10, 2021

  • Updated the onboarding flow - new customers should now get their credentials and a receipt seconds after purchasing
  • Improved data coverage of SaaS product use in the Static Site Builder and Search as a Service categories

2.8.10 - July 6, 2021

  • Improved the usability of the SourceStack webapp on mobile devices

2.8.9 - July 1, 2021

  • Fixed a bug that broke the formatting of the Pricing and Contact pages for Safari users

2.8.8 - June 25, 2021

  • Streamlined the checkout flow of our pricing page
  • Launched a publicly available FAQ
  • Fixed a pair of bugs wherein jobs_url and blog_url would return None instead of the standard empty string ""
  • Improved data coverage of SaaS product use in the Payments category

2.8.7 - June 21, 2021

  • Improved data coverage in the founded_year and phones fields
  • Updated and made our Terms of Service publicly viewable for non-customers

2.8.6 - June 19, 2021

  • Continued to expand the data coverage in social_url fields (e.g. facebook_url, linkedin_url)
  • Fixed a bug that was allowing nonstandard 2 character country codes in the country field (an exhaustive list of accepted country fields is here)
  • Fixed a bug that caused a lack of internal spaces in the h1 field

2.8.5 - June 16, 2021

  • Fixed a bug that broke the rendering of the homepage when a user followed a particular navigation path
  • Continued to expand the data coverage in _url fields (e.g. jobs_url, affiliate_url, login_url)
  • Improved data coverage in the founded_year and emails fields
  • Added Job Board and Weight Loss as /companies categories

2.8.4 - June 12, 2021

  • Added a Contact page - feel free to say hello
  • Added a Business Opt Out page for businesses who so choose to be permanently removed from SourceStack data

2.8.3 - June 8, 2021

  • Added Personal CRM and Channel & Partner Management as /products categories and a dozen matching products
  • Slightly improved data coverage in _url fields (e.g. jobs_url, affiliate_url, login_url)

2.8.2 - June 5, 2021

  • Deployed several bugfixes for formatting errors in the SourceStack webapp
  • Implemented a dozen or so copy and formatting tweaks across the Docs and webapp
  • Added support to query the /jobs dataset on post_url by adding exact=True

2.8.1 - June 2, 2021

  • Significantly expanded the breadth of the /companies dataset
  • Updated the Docs to more accurately reflect the behavior of GREATER_THAN and LESS_THAN with str-type columns. Using GREATER_THAN with a str col will return entries AFTER the value alphabetically
  • Updated the Docs to more accurately reflect the behavior of EQUALS with array-type columns. Using EQUALS with an array col will ONLY return entries with one-item arrays with that value, not every entry with that value in the array
  • Removed the ability to add NOT_EQUALS filters on array-type columns, as the behavior was frequently causing confusion

2.8.0 - May 25, 2021

  • Initial release of the SourceStack webapp - contact your account representative for access
  • Rearranged the url schema of much of the sourcestack.co site - old url slugs should 301 redirect to the new ones
  • Added No Code as a /companies category

2.7.0 - May 21, 2021

  • Enabled Transfer Acceleration on results generated by export=s3_csv; files will now download up to 7x faster
  • Fixed a security vulnerability that a motivated adversary could have used to access result CSVs before they are automatically deleted after 24 hours
  • Modified the message returned by export=s3_csv, export=gsheet, and export=airtable, so the url will now only be included in the link key:value pair

2.6.0 - May 19, 2021

  • Initial release of non-200 status_code entries in the /companies dataset. They are as follows:
    • 310 - SaaS specific Holding Page - Shopify Holding Page, BigCommerce Holding Page etc
    • 311 - URL redirects to a social network page - Twitter, Twitch, Calendly, etc
    • 312 - URL redirects to an ecommerce marketplace page - Amazon, Gumroad, Etsy, etc
    • 313 - URL redirects to a standalone Landing Page builder page - Carrd, Notion, etc
    • 410 - Domain Registrar specific Holding Page - GoDaddy Holding Page, HugeDomains Holding Page, etc
  • Accordingly, the breadth of the /companies dataset has increased
  • Initial release of the tld field in the /companies dataset
  • Added support for identifying IPv4 and IPv6 as tld values
  • Slightly improved latency of all dataset queries

2.5.1 - May 17, 2021

  • Fixed a bug that could cause less-recent indexes of entries be returned instead of the most up-to-date record in the /companies dataset
  • Fixed a separate bug that caused Unix timestamps to not be recognized as an Advanced Filtering (filters=) option
  • Added 8 new and merged several dozen duplicative tag_categories values for /products

2.5.0 - May 15, 2021

  • Initial release of the founded_year, founded_dt, reddit_url, angellist_url, customers_urls, affiliate_url, and login_url fields in /companies dataset
  • Expanded detection of websites that are Holding Pages (status_code 310, 311, 312, 313 and 410)
  • Scaled up /companies processing throughput significantly
  • Improved /skus processing logic to more frequently index stores with many SKUs
  • Slightly improved data coverage in datetime fields (e.g. sku_published_at, sku_created_at, sku_updated_at)

2.4.11 - May 11, 2021

  • Added additional standardization and data cleaning to values in the keywords field in the /companies dataset
  • Fixed a bug that could cause company_name to be truncated occasionally in the /companies dataset
  • Slightly improved data coverage of dozens of fields in the /jobs and /companies datasets
  • Improved the false negative rate in the addresses field

2.4.10 - May 9, 2021

  • Some domains will now have significantly better data coverage and depth of the tags_matched and tag_categories fields in the /companies dataset
  • Improved data coverage of the docs_url and support_url fields in the /companies dataset
  • Slightly improved data coverage of a dozen or so fields in the /jobs dataset

2.4.9 - May 5, 2021

  • Initial release of compensation fields - comp_est and comp_range in the /jobs dataset
  • Improved data coverage and depth of the categories field in the /companies dataset
  • Fixed a bug that was causing values for phones to be incorrectly formatted occasionally

2.4.8 - May 1, 2021

  • Expanded the breadth of the jobs dataset
  • Improved data coverage of the logo_url, currencies, hours, city, region, and country fields in the /jobs dataset

2.4.7 - April 28, 2021

  • Expanded the breadth of the companies dataset
  • Significantly expanded /products / tags_matched coverage of Advertising, Holding Page, and Timeseries Database SaaS products
  • Updated the tag_categories values for some Carts and Holding Page products that were missing the appropriate category

2.4.6 - April 27, 2021

  • Improved the positive match rate when querying with the url= search_param in the /companies dataset
  • Improved data coverage in datetime fields (e.g. sku_published_at, sku_created_at, sku_updated_at)
  • Minor improvements to data coverage across dozens of fields in the /companies and /jobs datasets

2.4.5 - April 21, 2021

  • Backend enqueuing logic has been improved to more frequently crawl high priority domains
  • Improved data coverage of logo_url, currencies, phones, and social_urls (facebook_url, pinterest_url, etc) fields in the /companies dataset
  • Improved data coverage of sku_weight and images fields in the /skus dataset
  • Fixed a bug wherein one of the values in the phones array could be nonstandard (i.e. have non-digit characters)

2.4.4 - April 15, 2021

  • Unsuccessful url= lookups on the /companies dataset will now enqueue the url to be processed; it will then be added to the queryable dataset within 24 hours
  • Improved data coverage and added Grant and Conditional values for the hours field in the /jobs dataset
  • Fixed a bug that could cause tag_categories to be incorrectly empty in some cases

2.4.3 - April 12, 2021

  • Fixed an enqueuing bug that caused some /skus domains to be crawled less frequently than intended
  • Significantly expanded the /products coverage of Crypto, Accessibility, and Automated Content Generation (e.g. GPT-3) SaaS products
  • You can now access the status_code field on entries in the /companies and /jobs datasets; at present, it will only return 200, as every other status_code is removed from the queryable datasets

2.4.2 - April 10, 2021

  • Initial release of the board_url, page_size, all_countries, linkedin_url, twitter_url, youtube_url, instagram_url, facebook_url, tiktok_url, pinterest_url, and github_url fields in the /jobs dataset
  • Fixed an Advanced Filtering bug where filtering (filters=) on one or more columns being Null was not properly applied
  • Fixed an edge case where addresses would be written as a str, rather than the proper list

2.4.1 - April 8, 2021

  • Initial release of the logo_url, hero_image_url, and all_languages fields in the /companies dataset
  • Fixed a bug causing false negatives in the education field in the /jobs dataset
  • Improved data coverage in the emails field in the across all datasets

2.4.0 - April 7, 2021

  • Initial release of the airtable option for the export parameter - you can now write query result data directly to an Airtable table. There is a onetime manual setup step (due to Airtable's API restrictions); please contact your account rep for access.
  • The API will now more gracefully handle an unsupported search_param value (category= and uses_category=) for search_params with a fixed set of Accepted Values

2.3.3 - April 5, 2021

  • Improved handling of encoding errors in string fields
  • Enhanced data coverage of the postal_code field in the /companies dataset
  • Better detection of malformed company_name (e.g. unpopulated JINJA) in every dataset
  • Implemented standardization of favicon_url in the /companies dataset

2.3.2 - April 2, 2021

  • Fixed a bug affecting the use of the language parameter in the /jobs dataset
  • Fixed a bug affecting the formatting of the job_description field in the /jobs dataset
  • Fixed an edge case where post_url was returned as None in the /jobs dataset
  • Improved data coverage of the region and country fields in the /jobs dataset
  • Updated the exhaustive list of supported Countries and Regions in the SourceStack Accepted Values Google Sheet

2.3.1 - March 24, 2021

  • Significant increase in /jobs dataset size
  • Initial release of the logo_url field in the /jobs dataset
  • Improved data coverage of the job_published_at field in the /jobs dataset
  • Added additional cleaning and standardization of company_name data in the /jobs dataset

2.3.0 - March 20, 2021

  • Initial release of the /categories dataset and corresponding endpoint

2.2.6 - March 18, 2021

  • Updated the Postman Collection queries to make them more standard and with a gentler learning curve
  • Updated the exhaustive list of supported Categories in the SourceStack Accepted Values Google Sheet

2.2.5 - March 16, 2021

  • Fixed a bug with the fields= parameter not recognizing certain combinations of fields in the /companies dataset
  • Fixed a separate bug allowing duplicate fields to be requested

2.2.4 - March 15, 2021

  • Added support for Count_Only in combination with Advanced Filtering (filters)

2.2.3 - March 11, 2021

  • Resolved an edge case of periodic high latency related to a scheduled cronjob
  • Improved the tolerance of filters for various typos

2.2.2 - March 6, 2021

  • Fixed a bug where some array fields were improperly formatted in the response object
  • Fixed a separate bug where some int fields were cast as strings in the response object

2.2.1 - March 1, 2021

  • Initial release of the X-SOURCESTACK-REQUEST-ID header; use this value in communications with our team if you believe there is an error in a request's response data
  • Shipped a handful of small bugfixes for filters edge cases

2.2.0 - February 22, 2021

  • Initial release of filters parameter - accordingly, support for multiple query conditions is now live
  • Initial release of first_indexed field

2.1.2 - February 16, 2021

  • Renamed posted_at field to job_published_at and created_at to job_created_at in /jobs data
  • Improved data coverage of the city, region, country, categories, language, job_description, last_modified, job_published_at, and job_created_at fields in /jobs data
  • Standardized response values for seniority, hours, region, country, and language fields in /jobs data
  • Initial release of postal_code field in /jobs data
  • Initial release of sku_description field in /skus data
  • Roughly doubled the breadth of /jobs data

2.1.1 - February 11, 2021

  • Initial release of shipping_url, returns_url, faq_url, blog_url, support_url, and terms_url fields
  • Improved data coverage of the currencies, city, and country fields in /companies data

2.1.0 - February 8, 2021

  • Initial release of order_by parameter
  • Initial release of urls parameter capability - passing a comma delimited string of multiple urls
  • Fixed a pair of visual bugs on the website itself
  • Implemented a few small quality-of-life changes to request rate limiting

2.0.1 - February 4, 2021

  • Made small updates to the docs to modernize out-of-date queries
  • Added better error reporting for typos in the fields param value
  • Fixed a bug affecting the formatting of twitter_url
  • Implemented a second layer of fallbacks to prevent 413 failures; they should now be exceedingly rare

2.0.0 - February 2, 2021

  • Breaking, incompatible changes were made to some field names. They are as follows:
Endpoint Old New
/companies product_count sku_count
/companies vendor_count sku_vendor_count
/companies average_price sku_average_price
/skus product_url sku_url
/skus product_id sku_id
/skus product_name sku_name
/skus product_handle sku_handle
/skus product_published_at sku_published_at
/skus product_created_at sku_created_at
/skus product_updated_at sku_updated_at
/skus vendor sku_vendor
/skus product_type sku_type
/skus tags categories
/skus images image_links
/skus product_digital is_digital
/skus product_taxable is_taxable
/skus product_weight sku_weight
/skus product_price sku_price
/skus highest_price variant_highest_price
/skus variants variant_count
  • Fixed a pair of bugs that caused returned field names to differ slightly than accepted input field names
  • The /skus endpoint now supports querying on the url of the product itself (&url=foo.com/products/bar&exact=True)
  • The /skus endpoint now supports querying on the on both sku_type and categories fields (&category=shoes&exact=False)
  • Added support for Run In Postman button (in the Example Queries docs) to download a Postman Collection of ~30 common queries

1.6.5 - January 28, 2021

  • Initial release of the fields parameter

1.6.4 - January 26, 2021

  • Initial release of sku_average_price, sku_vendor_count, sku_count fields, representing aggregate metrics for stores in the /companies dataset
  • Reprocessed Shopify Store data to subdivide into Shopify (active store), Shopify Holding Page (before setting up shop), Shopify Coming Soon Page, and Shopify Password Protected Page
  • Rolled out a pair of bugfixes for edge cases relating to large request sizes

1.6.3 - January 25, 2021

  • Initial release of the /quota endpoint
  • Successful API responses now include the X-SOURCESTACK-CREDITS-REMAINING header

1.6.2 - January 22, 2021

  • Initial release of app_urls field
  • Refactored strict param to be called exact instead. Backward compatibility will be maintained.

1.6.1 - January 21, 2021

  • Significantly improved latency on the /companies endpoint
  • Fixed an edge case where duplicate companies were being returned

1.6.0 - January 15, 2021

  • Initial release of the /jobs endpoint
  • Initial release of corresponding [job_name, job_location, hours, department, seniority, education, remote, company_name, company_description, company_url, post_url, last_indexed, last_modified, posted_at, tags_matched, tag_categories, categories, page_size, language] fields

1.5.9 - January 9, 2021

  • Improved data coverage of last_modified field
  • Standardized and improved readability of several SKU fields
  • Added detection support for a substantial number of new shop apps

1.5.8 - January 6, 2021

  • Initial release of contact_url, about_url, and docs_url fields
  • Improved data coverage of currencies field
  • Removed some product categories that were largely duplicative of others

1.5.7 - January 4, 2021

  • Initial release of alexa_rank, majestic_rank, umbrella_rank fields

1.5.6 - January 2, 2021

  • Added support for Magento themes

1.5.5 - December 30, 2020

  • Initial release of jobs_url, facebook_url, tiktok_url, and currencies fields

1.5.4 - December 28, 2020

  • Improved preprocessing agent; some queries should be 20-30% faster now
  • Significantly improved latency on the /skus endpoint

1.5.3 - December 26, 2020

  • Added support for Wordpress themes

1.5.2 - December 23, 2020

  • Significantly expanded coverage of Shopify apps
  • Initial release of theme_id, theme_name, and theme_parent_id fields
  • Added support for Shopify themes via above fields

1.5.1 - December 20, 2020

  • fixed an edge case where some large queries would return duplicate rows

1.5.0 - December 17, 2020

  • Rebuilt categorization engine, adding 59 new company categories. As of writing, there are 157 company categories live.
  • Implemented a data preprocessing agent to improve query speed. Some categories of queries should experience up to 7x faster responses!

1.4.4 - December 14, 2020

  • Initial release of domain, pricing_url, pinterest_url, facebook_page_id, and facebook_admin_ids fields

1.4.3 - December 12, 2020

  • Added a number of Cart, Payment, and Paid Social Ad Platforms products
  • Improved the UX and query latency of url= search parameter calls

1.4.2 - December 10, 2020

  • Standardized language values across all rows

1.4.1 - December 9, 2020

  • Made a series of changes to deduplicate products and update their parent company (e.g. for products where the company was acquired)
  • Made a handful of minor tweaks that will serve to hedge false positive tag application rate

1.4.0 - December 7, 2020

  • Initial release of /skus endpoint
  • Increased the service limit for export=gsheet from 50,000 to 100,000

1.3.6 - December 5, 2020

  • Made significant improvements to query speeds across larger results
  • API calls timing out should accordingly decrease significantly

1.3.5 - December 3, 2020

  • Added support for case-insensitive queries on uses_product, uses_category, and category (other params already support it)
  • Added support for strict=False on /companies?uses_product
  • Enabled querying on SaaS vendor specific Holding Pages, for example: "Shopify Holding Page"

1.3.4 - December 1, 2020

  • A search query without a value now returns 422 with a specific message, rather than previous generic 500
  • API Docs now refer to X-API-KEY, rather than x-api-key. Headers in a HTTP request are case-insensitive, so this should not affect anyone.

1.3.3 - November 29, 2020

  • Fixed a parsing bug that caused some product tags to not be applied (false negatives)
  • Implemented a check to prevent CAPTCHA'd sites that returned 200 codes from being added to the queryable DB

1.3.2 - November 28, 2020

  • Added detection for Shopify 'coming soon' parking pages
  • Added a broader selection of Cart products
  • Initial release of language parameter

1.3.1 - November 27, 2020

  • Initial release of uses_category parameter
  • Implemented burst and overall rate limiting

1.3.0 - November 26, 2020

  • Responses that formerly returned a 204 for "no rows" now return 200 instead, as Postman won't display any returned keys with a 204 code
  • 202 will be returned in all cases where a link is generated; previously only fallback exports got a modified code (formerly 206)

1.2.7 - November 25, 2020

  • Responses that formerly returned a 404 for "no rows" now return 204 instead, indicating that 0 rows were successfully found
  • Implemented a fix to 204 code responses not returning data key:value (now returns empty list)

1.2.6 - November 19, 2020

  • Updated s3_csv and gsheet export options to dynamically share access permissions for the resources with the caller

1.2.5 - November 16, 2020

  • Added strict=False option on search_param url

1.2.4 - November 13, 2020

  • Standardized message response key:value across all responses
  • Standardized entry_count response key:value across 200 and 202 responses

1.2.3 - November 10, 2020

  • Initial release of uses_product parameter
  • Implemented fallbacks for the export parameter, where the returned row volume is not feasible in the specified export option

1.2.2 - November 8, 2020

  • Initial release of parent parameter

1.2.1 - November 5, 2020

  • Initial release of category parameter

1.2.0 - November 3, 2020

  • Initial release of export parameter
  • Implemented service export limits for the options available in the export parameter

1.1.2 - November 1, 2020

  • Initial release of count_only parameter
  • Fixed a pair of edge cases related to parameter permutations

1.1.1 - October 30, 2020

  • Initial release of name and url parameters

1.1.0 - October 29, 2020

  • Initial release of /companies endpoint

1.0.0 - October 21, 2020

  • Initial release of /products endpoint