Introduction

Reelgood's S3 Export products are large data exports that provide the complete metadata, images, and streaming availability across all the streaming services available in the market. These exports are massive files containing millions of TV shows, movies, and episodes as well as talent metadata along with the streaming services where they are available.

The S3 Export product is delivered to customers via Amazon S3 (standard). If you have a constraint using S3, we can explore other delivery options.

Target Audience

Any enterprise interested in consuming the most accurate raw streaming data would benefit from the S3 Export product. Key benefits include:

• Flexibility - Complete flexibility in how you process Reelgood's catalog metadata. Slice and dice the data as desired or build your own custom data formats or fields on top of the exports.
• Integration - Easy integration with an existing database or CMS, especially if it's in the cloud.
• Scalability - Built for global enterprises. Scales seamlessly to include multiple territories and additional data products as we expand internationally.
• Tech-focused - Geared for tech-savvy customers who prefer to set up their own infrastructure and build and maintain a movie/TV show database and streaming catalog availability index.

Use Cases

The S3 Export product is designed to solve most use cases geared towards streaming data. Common applications include:

• Search & Discovery - Build your own search and discovery platforms with browse and recommendations to drive user engagement.
• Recommendation Engines - Streaming availability tied to content metadata like genres, keywords, and tags makes up a crucial ingredient for personalized recommendations.
• Competitive Insights - Visualize your own data side by side with competitors to build content strategy.
• Search Engines & Voice Assistants - Power entertainment queries on search engines and voice assistant devices with up-to-date availability data.
• Media Investment Planning - Understand audience preference signals based on what content is performing well on which services, and invest accordingly.
• Content Lifetime Analysis - Track how content gets picked up by multiple services for redistribution to understand the shelf life of different content types.
• Marketing ROI Analytics - Derive ROI on marketing and promotional dollars for media and content-focused platforms.

Accessing the Amazon S3 Bucket

What is Amazon S3?

Cloud-based data storage. An Amazon S3 "bucket" is analogous to a directory or top-level folder in other tools.

Getting access to Amazon S3

1. Sign up for an AWS account (free).
2. Set up users and groups as desired.
3. Log in to an AWS account with IAM access, and grant s3FullAccess permissions to the desired user or group.

What to provide to Reelgood

Provide your AWS IAM Amazon Resource Name (ARN) in one of the following formats:

arn:aws:iam::[12-digit AWS account ID]:user/[username]
arn:aws:iam::[12-digit AWS account ID]:root

Looking up your AWS account ID

Find your AWS IAM ARN at IAM Security Credentials under Account Identifiers.

You can create a new user and attach this policy for full S3 access:

{
  "Version": "2012-10-17",
  "Statement": [
    {
      "Effect": "Allow",
      "Action": "s3:*",
      "Resource": "*"
    }
  ]
}

What you'll receive from Reelgood

A link to your bucket within Reelgood's Amazon S3 account.

Contents of the Bucket

Your bucket will contain folders and files depending on your subscription. Files are not encrypted and are in line-delimited JSON format. You can download these files and load them into your own database, or run Amazon Athena DDL statements on them to create queryable tables.

For detailed field-level documentation, see the Reelgood Sample Data Export spreadsheet, which has one tab per folder showing all available fields.

Record Counts

For a full United States subscription across all streaming services and metadata fields, the approximate daily file size is ~1.8GB (excluding historical data). Record counts for key tables:

Data Updates

What time periods do the files represent?

All files always contain data for the current date only, with the exception of the /historical folder, which contains data for previous dates.

How often are files updated?

All files in all folders are rewritten up to twice a day, depending on your contract.

Should I save historical copies?

The sources, movies, shows, and episodes folders always contain a full copy of the latest catalog. The global_movie_availability and global_episode_availability folders contain streaming availability data for the current day. The movie_sources and episode_sources folders contain rent/buy prices on relevant streaming services for the current day.