Arquitecturas de Big Data from Coursera

El curso de Arquitecturas de Big Data busca que identifiques las características de una solución de Big Data, los datos asociados a estas soluciones, la infraestructura requerida, y las técnicas de procesamiento escalable. Desarrollaremos ejemplos usando infraestructuras basadas en Hadoop y en Spark, teniendo presente la pertinencia de las plataformas basadas en nube pública para soportar la escalabilidad de estas soluciones.

El curso está dirigido a personas con conocimientos básicos en manejo de herramientas computacionales y programación en al menos uno de estos lenguajes (Python, Java).

Dado que en este curso se hará uso de un programa descargable, aseguraté de tener un computador con la siguiente configuración mínima:

Mínimo 8 GB de memoria RAM.

Mínimo 200 GB de espacio libre en disco.

Alguno de los siguientes sistemas operativos: Windows, Linux, Macintosh, o Solaris.

What's inside

Syllabus

Introducción

Te damos la bienvenida al curso "Arquitecturas de Big Data". Te invitamos a realizar las lecturas sobre acceso al curso y recursos.

¿Qué es Big Data?

Bienvenido al primer módulo del curso. En este módulo responderemos a la pregunta ¿Qué es el Big Data? Para ellos nos centraremos en conocer como llegamos hoy al Big Data, cuáles son las 3V principales e identificaremos las diferencias que tiene Big Data con las arquitecturas tradicionales.

¿Cómo almacenamos Big Data?

Bienvenido al segundo módulo del curso. Dentro de este módulo nos centraremos en responder a la pregunta ¿Cómo almacenamos Big Data? Para ello identificaremos los requerimientos y desafíos de almacenamiento de Big Data, conoceremos acerca de la arquitectura conceptual y veremos algunos ejemplos, y conoceremos sobre sistemas de archivos distribuidos y sistemas manejadores de bases de datos NoSQL.

¿Cómo procesamos Big Data?

Bienvenido al tercer módulo del curso. Durante el desarrollo de este módulo nos enfocaremos en responder a la pregunta ¿Cómo procesamos Big Data? Para ello trabajaremos en tres temas principales: Procesamiento escalable y Map-Rediuce, Spark y Arquitecturas para procesamientos de datos de flujos.

¿Cuál es el rol de la nube en entornos Big Data?

Te damos la bienvenida al cuarto y último módulo de nuestro curso. Durante este módulo responderemos a la pregunta ¿Cuál es el rol de la nube en entornos Big Data? Para ello, una vez comprendamos los aspectos conceptuales, revisaremos las posibilidades de procesamiento y almacenamiento que hacen de la nube un entorno ideal para Big Data. También revisaremos las ventajas y riesgos de utilizar servicios públicos en la nube.

Good to know

Know what's good

, what to watch for

, and possible dealbreakers

Explora los fundamentos del Big Data, cubriendo conceptos clave y los desafíos asociados con el almacenamiento y procesamiento de datos a gran escala

Proporciona ejemplos prácticos utilizando infraestructuras basadas en Hadoop y Spark, lo que demuestra su aplicación en escenarios del mundo real

Los instructores son expertos en el campo de Big Data, lo que garantiza la calidad del contenido y la información actualizada

Cubre tecnologías emergentes como Spark y la computación en la nube, preparándote para las tendencias actuales de la industria

Requiere conocimientos básicos de programación y manejo de herramientas computacionales, lo que lo hace adecuado para estudiantes con experiencia previa

El curso requiere un equipo con una configuración mínima específica, lo que puede ser una limitación para algunos estudiantes

Activities

Be better prepared before your course. Deepen your understanding during and after it. Supplement your coursework and achieve mastery of the topics covered in Arquitecturas de Big Data with these activities:

Revise Hadoop and Spark concepts

Show steps

Brushing up on Hadoop and Spark fundamentals will provide a solid foundation for understanding the course material.

Show steps

Review Hadoop Distributed File System (HDFS) architecture and concepts
Revisit Spark's resilient distributed datasets (RDDs) and transformations
Explore Spark's machine learning library (MLlib)

Compile a glossary of Big Data terms

Show steps

Creating a glossary will enhance your understanding of key Big Data terminologies and their usage.

Show steps

Identify and extract important terms from course materials
Define each term clearly and concisely
Categorize terms into relevant groups
Share the glossary with peers for feedback and refinement

Explore advanced Spark techniques

Show steps

Delving into advanced Spark techniques will expand your knowledge and enable you to handle complex Big Data scenarios.

Browse courses on Spark Streaming

Show steps

Follow online tutorials on Spark Streaming for real-time data processing
Explore Spark GraphX for graph analytics
Utilize Spark SQL for structured data analysis

Two other activities

Expand to see all activities and additional details

Show all five activities

Solve Big Data case studies

Show steps

Working through case studies will equip you with practical experience in applying Big Data techniques to real-world problems.

Browse courses on Big Data Applications

Show steps

Identify a Big Data case study aligned with your interests
Analyze the problem statement and data provided
Design and implement a solution using appropriate Big Data tools and techniques
Present your findings and recommendations

Contribute to an open-source Big Data project

Show steps

Contributing to open-source projects will not only enhance your technical skills but also connect you with the Big Data community.

Browse courses on Apache Hadoop

Show steps

Identify an open-source Big Data project that aligns with your interests
Review the project's documentation and codebase
Identify areas where you can contribute, such as bug fixes or feature enhancements
Submit a pull request with your proposed changes

Career center

Learners who complete Arquitecturas de Big Data will develop knowledge and skills that may be useful to these careers:

Big Data Architect

A Big Data Architect designs and implements the technical infrastructure for managing and processing large datasets. They work with data engineers and data scientists to ensure that the data platform meets the needs of the business. The course 'Arquitecturas de Big Data' is highly relevant as it provides a deep understanding of Big Data technologies and their application in real-world scenarios. It prepares you for the challenges of designing and managing scalable and reliable Big Data solutions.

See salaries and explore the career path for Big Data Architect

Data Engineer

A Data Engineer designs, builds, and maintains the infrastructure that stores and processes large datasets. They develop the pipelines that move data between different systems and ensure that the data is accessible and usable by data analysts and other users. The course 'Arquitecturas de Big Data' is highly relevant as it provides hands-on experience with Hadoop and Spark, two widely used frameworks for processing Big Data. You will also learn about cloud computing platforms that are essential for scaling and supporting Big Data solutions.

See salaries and explore the career path for Data Engineer

Big Data Consultant

A Big Data Consultant advises organizations on how to use Big Data technologies to achieve their business goals. They work with clients to understand their business needs and develop and implement Big Data solutions that meet those needs. The course 'Arquitecturas de Big Data' provides a comprehensive overview of Big Data technologies and their application in real-world scenarios. It prepares you for the challenges of advising clients on how to use Big Data to solve their business problems.

See salaries and explore the career path for Big Data Consultant

Data Analyst

A Data Analyst combines advanced analytical techniques with programming skills to find meaningful patterns in data. An important requirement is the ability to understand the underlying software systems that collect and store large datasets. The course 'Arquitecturas de Big Data' at Universidad de los Andes provides a solid foundation in data storage, processing, and cloud computing. It prepares you for the challenges of analyzing and interpreting massive datasets to make data-driven decisions.

See salaries and explore the career path for Data Analyst

Data Scientist

Data Scientists use scientific methods and machine learning algorithms to extract insights from data. They work with large and complex datasets to identify trends, patterns, and anomalies. A strong understanding of data storage and processing is essential for Data Scientists, as they need to be able to access and manipulate large datasets efficiently. The course 'Arquitecturas de Big Data' provides a comprehensive overview of Big Data technologies, including storage systems, processing frameworks, and cloud computing platforms. It prepares you for the challenges of working with massive datasets and developing data-driven solutions.

See salaries and explore the career path for Data Scientist

Data Warehouse Architect

A Data Warehouse Architect designs and implements data warehouses. They work with data analysts and other users to understand their needs and design and implement data warehouses that meet those needs. A strong understanding of Big Data technologies is essential for Data Warehouse Architects, as many data warehouses are used to store and process large datasets. The course 'Arquitecturas de Big Data' provides a comprehensive overview of Big Data technologies and their application in data warehousing. It prepares you for the challenges of designing and managing scalable and reliable data warehouses.

See salaries and explore the career path for Data Warehouse Architect

Business Intelligence Analyst

A Business Intelligence Analyst uses data to help organizations make better decisions. They work with data to identify trends, patterns, and anomalies, and develop insights that can be used to improve business performance. A strong understanding of Big Data technologies is becoming increasingly important for Business Intelligence Analysts, as more and more organizations are using Big Data to gain insights into their business. The course 'Arquitecturas de Big Data' provides a comprehensive overview of Big Data technologies and their application in business intelligence. It prepares you for the challenges of using Big Data to identify insights that can improve business performance.

See salaries and explore the career path for Business Intelligence Analyst

Cloud Architect

A Cloud Architect designs and manages cloud computing solutions. They work with clients to understand their business needs and design and implement cloud-based solutions that meet those needs. A strong understanding of Big Data technologies is essential for Cloud Architects, as many cloud platforms offer Big Data services. The course 'Arquitecturas de Big Data' provides a comprehensive overview of Big Data technologies and their application in cloud computing environments. It prepares you for the challenges of designing and managing scalable and reliable cloud-based Big Data solutions.

See salaries and explore the career path for Cloud Architect

Data Management Specialist

A Data Management Specialist ensures that data is managed in a consistent and reliable manner. They work with data owners to develop and implement data management policies and procedures. A strong understanding of Big Data technologies is becoming increasingly important for Data Management Specialists, as more and more organizations are adopting Big Data solutions. The course 'Arquitecturas de Big Data' provides a comprehensive overview of Big Data technologies and their application in data management. It prepares you for the challenges of managing Big Data in a consistent and reliable manner.

See salaries and explore the career path for Data Management Specialist

Database Administrator

A Database Administrator (DBA) manages and maintains databases. They ensure that the databases are available, secure, and performant. DBAs need to have a strong understanding of data storage and processing technologies, as well as the ability to troubleshoot and resolve database issues. The course 'Arquitecturas de Big Data' provides a solid foundation in Big Data storage and processing technologies, which can be beneficial for DBAs who want to work with Big Data environments.

See salaries and explore the career path for Database Administrator

Software Engineer

A Software Engineer designs, develops, and maintains software applications. They work with users to understand their needs and develop software solutions that meet those needs. A strong understanding of data storage and processing technologies is becoming increasingly important for Software Engineers, as more and more applications are being developed to handle large datasets. The course 'Arquitecturas de Big Data' provides a comprehensive overview of Big Data technologies and their application in software development. It can be beneficial for Software Engineers who want to develop data-intensive applications.

See salaries and explore the career path for Software Engineer

Information Security Analyst

An Information Security Analyst protects an organization's data and IT systems from unauthorized access, use, disclosure, disruption, modification, or destruction. A strong understanding of Big Data technologies is becoming increasingly important for Information Security Analysts, as more and more organizations are adopting Big Data solutions. The course 'Arquitecturas de Big Data' provides a comprehensive overview of Big Data technologies and their application in information security. It prepares you for the challenges of protecting Big Data from unauthorized access and other security threats.

See salaries and explore the career path for Information Security Analyst

Systems Engineer

A Systems Engineer designs, builds, and maintains computer systems. They work with users to understand their needs and design and implement systems that meet those needs. A strong understanding of Big Data technologies is becoming increasingly important for Systems Engineers, as more and more systems are being developed to handle large datasets. The course 'Arquitecturas de Big Data' provides a comprehensive overview of Big Data technologies and their application in systems engineering. It can be beneficial for Systems Engineers who want to design and manage systems that handle large datasets.

See salaries and explore the career path for Systems Engineer

Technical Architect

A Technical Architect designs and manages the technical infrastructure of an organization. They work with business leaders to understand the organization's business needs and design and implement technical solutions that meet those needs. A strong understanding of Big Data technologies is becoming increasingly important for Technical Architects, as more and more organizations are adopting Big Data solutions. The course 'Arquitecturas de Big Data' provides a comprehensive overview of Big Data technologies and their application in enterprise environments. It can be beneficial for Technical Architects who want to design and manage technical infrastructures that support Big Data solutions.

See salaries and explore the career path for Technical Architect

Enterprise Architect

An Enterprise Architect designs and implements the overall architecture of an organization's IT systems. They work with business leaders to understand the organization's business needs and design and implement IT systems that meet those needs. A strong understanding of Big Data technologies is becoming increasingly important for Enterprise Architects, as more and more organizations are adopting Big Data solutions. The course 'Arquitecturas de Big Data' provides a comprehensive overview of Big Data technologies and their application in enterprise environments. It prepares you for the challenges of designing and implementing IT systems that support Big Data solutions.

See salaries and explore the career path for Enterprise Architect