API Design for ETL: CodeMash from Pluralsight

CodeMash 2020 | API Design for ETL - Lessons from Nearly 100 Data Integrations in the Wild | Dan Mosora

In the API Economy, users increasingly want to analyze and connect more of their business data, from small startup shops to multinational corporations. Are you thinking about making data available through an API? There are innumerable ways to slice the problem. How do you implement pagination? What data model makes sense? What level of authentication is correct to be secure but usable? At Stitch, the teams have built and reviewed almost 100 data integrations in Python for the Singer project, most of which interact with APIs, and have had good experiences and not-so-good experiences. In this conference talk, Dan Mosora will explore these lessons through APIs in the wild, cover the challenges that Stitch has faced when integrating with an API for ETL purposes, and highlight the qualities that make an API a joy to interact with.

What's inside

Syllabus

API Design for ETL - Lessons from Nearly 100 Data Integrations in the Wild

Good to know

Know what's good

, what to watch for

, and possible dealbreakers

Offers practical, in-field insights from a team who has designed and reviewed almost 100 data integrations in Python for the Singer project, which interacts with APIs

Focuses on real-world scenarios, such as implementing pagination, determining the appropriate data model, and selecting the correct level of authentication

Provides valuable information for learners who are considering making data available through an API

Taught by Dan Mosora, who has extensive experience in API design and ETL

Covers important topics such as the challenges of integrating with an API for ETL purposes and the qualities of a user-friendly API

Career center

Learners who complete API Design for ETL: CodeMash will develop knowledge and skills that may be useful to these careers:

Data Engineer

Data Engineers are responsible for designing, building, and maintaining data pipelines that move data from source systems to target systems. This course can help Data Engineers learn how to design APIs that are efficient and easy to use for ETL purposes. The course will also cover the challenges that Data Engineers face when integrating with APIs for ETL purposes, and highlight the qualities that make an API a joy to interact with.

See salaries and explore the career path for Data Engineer

Data Architect

Data Architects are responsible for designing and managing the data architecture of an organization. This course can help Data Architects learn how to design APIs that are consistent with the organization's data architecture. The course will also cover the challenges that Data Architects face when integrating with APIs for ETL purposes, and highlight the qualities that make an API a joy to interact with.

See salaries and explore the career path for Data Architect

Integration Architect

Integration Architects are responsible for designing and implementing integrations between different systems. This course can help Integration Architects learn how to design APIs that are easy to integrate with. The course will also cover the challenges that Integration Architects face when integrating with APIs for ETL purposes, and highlight the qualities that make an API a joy to interact with.

See salaries and explore the career path for Integration Architect

Software Engineer

Software Engineers are responsible for designing, developing, and maintaining software applications. This course can help Software Engineers learn how to design APIs that are efficient, reliable, and easy to use. The course will also cover the challenges that Software Engineers face when integrating with APIs for ETL purposes, and highlight the qualities that make an API a joy to interact with.

See salaries and explore the career path for Software Engineer

Data Scientist

Data Scientists are responsible for using data to solve business problems. This course can help Data Scientists learn how to access and use data from APIs. The course will also cover the challenges that Data Scientists face when integrating with APIs for ETL purposes, and highlight the qualities that make an API a joy to interact with.

See salaries and explore the career path for Data Scientist

Business Analyst

Business Analysts are responsible for understanding the business needs of an organization and developing solutions to meet those needs. This course can help Business Analysts learn how to use APIs to access and use data to support their work. The course will also cover the challenges that Business Analysts face when integrating with APIs for ETL purposes, and highlight the qualities that make an API a joy to interact with.

See salaries and explore the career path for Business Analyst

Product Manager

Product Managers are responsible for managing the development and launch of new products. This course can help Product Managers learn how to design APIs that are easy to use for their customers. The course will also cover the challenges that Product Managers face when integrating with APIs for ETL purposes, and highlight the qualities that make an API a joy to interact with.

See salaries and explore the career path for Product Manager

Project Manager

Project Managers are responsible for planning and executing projects. This course can help Project Managers learn how to manage projects that involve integrating with APIs. The course will also cover the challenges that Project Managers face when integrating with APIs for ETL purposes, and highlight the qualities that make an API a joy to interact with.

See salaries and explore the career path for Project Manager

Technical Writer

Technical Writers are responsible for creating documentation for software and other technical products. This course can help Technical Writers learn how to write documentation for APIs. The course will also cover the challenges that Technical Writers face when documenting APIs for ETL purposes, and highlight the qualities that make an API a joy to interact with.

See salaries and explore the career path for Technical Writer

Quality Assurance Analyst

Quality Assurance Analysts are responsible for testing software to ensure that it meets the requirements of the users. This course can help Quality Assurance Analysts learn how to test APIs. The course will also cover the challenges that Quality Assurance Analysts face when testing APIs for ETL purposes, and highlight the qualities that make an API a joy to interact with.

See salaries and explore the career path for Quality Assurance Analyst

Database Administrator

Database Administrators are responsible for managing and maintaining databases. This course can help Database Administrators learn how to design and manage databases that are used for ETL purposes. The course will also cover the challenges that Database Administrators face when integrating with APIs for ETL purposes, and highlight the qualities that make an API a joy to interact with.

See salaries and explore the career path for Database Administrator

Data Analyst

Data Analysts are responsible for analyzing data to identify trends and patterns. This course can help Data Analysts learn how to use APIs to access and use data for their work. The course will also cover the challenges that Data Analysts face when integrating with APIs for ETL purposes, and highlight the qualities that make an API a joy to interact with.

See salaries and explore the career path for Data Analyst

Information Architect

Information Architects are responsible for designing and organizing the information in an organization. This course can help Information Architects learn how to design APIs that are easy to use and navigate. The course will also cover the challenges that Information Architects face when integrating with APIs for ETL purposes, and highlight the qualities that make an API a joy to interact with.

See salaries and explore the career path for Information Architect

User Experience Designer

User Experience Designers are responsible for designing the user interface of software products. This course can help User Experience Designers learn how to design APIs that are easy to use and understand. The course will also cover the challenges that User Experience Designers face when integrating with APIs for ETL purposes, and highlight the qualities that make an API a joy to interact with.

See salaries and explore the career path for User Experience Designer

Information Security Analyst

Information Security Analysts are responsible for protecting the information assets of an organization. This course can help Information Security Analysts learn how to secure APIs. The course will also cover the challenges that Information Security Analysts face when securing APIs for ETL purposes, and highlight the qualities that make an API a joy to interact with.

See salaries and explore the career path for Information Security Analyst

Reading list

We haven't picked any books for this reading list yet.

API Design for ETL

CodeMash

What's inside

Syllabus

Good to know

Save this course

Activities

Career center

Reading list

Share

Similar courses