We may earn an affiliate commission when you visit our partners.
Curtis Thompson
In this course, you will learn next-level thinking about value creation with Dark Data, using a principled approach that demonstrates your ability to use dark data to add value to an end-deliverable.
Register for this course and see more details by visiting:
OpenCourser.com/course/ddehpg/value
What's inside
Syllabus
Course Introduction
Welcome to Value Creation with Dark Data. We are excited that you are here and hope you finish this course with working knowledge of creating value by using dark data and the foundational ideas of dark data. In this course, you will work through a project scenario to identify and leverage data to create a solution.
Read more
Syllabus
Course Introduction
Welcome to Value Creation with Dark Data. We are excited that you are here and hope you finish this course with working knowledge of creating value by using dark data and the foundational ideas of dark data. In this course, you will work through a project scenario to identify and leverage data to create a solution.
Read more
Module 1: Dark Data Design Principles
In this module, you will be learning more about dark data and putting the principles of working with dark data into practice. This is important as your understanding now will inform how you work toward a solution in the project in Module 2. Think about what you know, what you are learning now, and what you might use in the future as you work through this module.
Module 2: Foundations for Dark Intelligence and Value Creation
As you move through this module, remember that your focus now is to shift from knowing to practicing; that is, being able to use what you know. In this module, you will learn about insight, intelligence, and data management. These will all be important as you begin your project in the next module.
Module 3: Advanced Engineering Capacity Management Project
It is now time for you to put your new knowledge and skills into practice. In this project, you will work with a common problem that vexes Fortune 500 companies. Companies constantly struggle to ensure that they have enough engineering capacity to build the software applications they need to provide appropriate staffing levels. Staffing appropriately includes not only having the right people available at the right time but also reducing the amount of over and idle time for engineers while ensuring the pace of projects is appropriate for business needs.
In this project, you need to find a way to manage and transform the data and automate the engineering measurement, tracking, and reporting for a large corporation. You will download and use a complex spreadsheet for this task. There is no simple answer to this problem; in fact, there are some very wrong answers and many ways to approach this problem that can work. The right answer will always be the one that enables you to:
1. have a clear line of sight into the teams work
2. improve the ability to measure teams in a more uniform manner
3. improve the ability of your organization to manage engineering processes uniformly
4. map engineering efforts toward enterprise and organizational goals
5. automate effort and capacity reporting
6. improve capacity and effort transparency enterprise-wide
7. map business outcomes to the actual engineering work and products being delivered
The danger to be aware of here is the dark data. When you do not know what you are missing, you can easily think you are successful when you are not. As you work through this problem, consider all you have learned about dark data in this course and use that knowledge to learn from the data, apply your knowledge of business and engineering teams, transform and enrich the data, and develop an end-user dashboard that allows people to quickly understand capacity at a high-level and allows them to dive into the details.
Quick note: When we speak of engineering capacity, it refers to the amount of engineering ability available to deliver software applications needed for business use.
Good to know
Good to know
Know what's good ,
what to watch for , and
possible dealbreakers
Provides a practical approach to data analytics
Suitable for individuals seeking to develop analytical skills
Save this course
Save Value Creation with Dark Data to your list so you can find it easily later:
Save
Save
Activities
Be better prepared
before
your course. Deepen your understanding
during
and
after
it. Supplement your coursework and achieve mastery of the topics covered
in Value Creation with Dark Data with these
activities:
Seek guidance from a mentor in the field of dark data
Show steps
Connect with an experienced professional in the field of dark data for guidance and support, accelerating your learning and career growth.
Browse courses on
Mentorship
Show steps
-
Establish regular meetings and seek advice
-
Identify potential mentors
-
Reach out and request mentorship
Review Data Modeling Techniques
Show steps
Refresh your understanding of data modeling concepts for effective dark data management
Browse courses on
Data Modeling
Show steps
-
Review ER modeling and normalization techniques
-
Practice designing data models for dark data scenarios
Connect with professionals in the field of dark data management
Show steps
Expand your professional network by attending events and connecting with individuals involved in dark data management, gaining insights and potential collaborations.
Browse courses on
Networking
Show steps
-
Identify networking events or conferences
-
Prepare an elevator pitch or brief introduction
-
Attend the event and actively engage with others
14 other activities
Expand to see all activities and additional details
Show all 17 activities
Explore open-source tools for dark data analysis
Show steps
Familiarize yourself with open-source tools that can assist in dark data analysis, expanding your knowledge of practical techniques and technologies.
Show steps
-
Identify and research open-source tools for dark data processing
-
Install and configure the tools
-
Follow tutorials or documentation to learn their functionality
Attend a Data Analytics Meet-up
Show steps
Network with professionals in the field and exchange ideas on dark data analytics.
Show steps
-
Identify and attend a local data analytics or dark data management meet-up.
-
Connect with other attendees and learn about their experiences and insights.
Attend a workshop on dark data management
Show steps
Participate in a workshop that provides hands-on experience with dark data management practices, enhancing your understanding of real-world implementation.
Browse courses on
Data Governance
Show steps
-
Research and identify relevant workshops
-
Register and attend the workshop
-
Actively participate and engage with experts and peers
Practice sizing dark data
Show steps
Use a spreadsheet or other tool to estimate the size of dark data in an organization. This will help you understand the scale of the problem and the potential value of using dark data to create value.
Browse courses on
Dark Data
Show steps
-
Identify the different types of dark data in an organization.
-
Estimate the volume of each type of dark data.
-
Calculate the total size of dark data in the organization.
Build a Dataset Inventory
Show steps
Create a comprehensive inventory to keep track of all dark data sources in your organization
Browse courses on
Data Management
Show steps
-
Identify and classify data sources
-
Document data lineage and relationships
-
Establish data ownership and stewardship
Build a data pipeline to transform and enrich dark data
Show steps
Develop hands-on experience with building a data pipeline that can transform and enrich dark data, enhancing your understanding of the principles and techniques discussed in the course.
Browse courses on
Data Pipelines
Show steps
-
Design the pipeline architecture
-
Implement data ingestion and transformation
-
Enrich data with external sources
-
Build a data visualization dashboard
Engage in peer-led discussions on dark data
Show steps
Foster deeper understanding and exchange ideas by participating in peer-led discussions on dark data, benefiting from multiple perspectives and collaborative problem-solving.
Show steps
-
Identify a group of peers with similar interests
-
Establish regular meeting times
-
Prepare discussion topics and facilitate the sessions
Identify dark data opportunities
Show steps
Brainstorm a list of potential opportunities to use dark data to create value. This could include using dark data to improve decision-making, identify new customers, or develop new products.
Browse courses on
Dark Data
Show steps
-
Review the different types of dark data in an organization.
-
Identify the potential benefits of using dark data.
-
Brainstorm a list of potential opportunities to use dark data to create value.
Data Transformation and Enrichment Exercises
Show steps
Improve your data manipulation and enrichment skills for dark data analysis.
Browse courses on
Data Transformation
Show steps
-
Work through the provided data transformation exercises in the course.
-
Find additional datasets and practice data transformation and enrichment techniques.
Data Cleaning and Transformation Challenges
Show steps
Practice resolving common data quality issues encountered in dark data
Browse courses on
Data Cleaning
Show steps
-
Handle missing values and outliers
-
Standardize and harmonize data formats
-
Apply data transformations and aggregations
Solve dark data analysis challenges
Show steps
Engage in practical exercises designed to improve your ability to analyze and interpret dark data, applying the concepts and techniques covered in the course.
Browse courses on
Data Interpretation
Show steps
-
Identify and analyze dark data sources
-
Extract meaningful insights from unstructured data
-
Develop visualization techniques to present findings
Design a Data Visualization Dashboard
Show steps
Develop a dashboard that visually represents dark data insights to aid decision-making
Browse courses on
Data Visualization
Show steps
-
Identify key metrics and KPIs
-
Select appropriate visualization techniques
-
Design and implement the dashboard
Write a white paper on the value of dark data
Show steps
Demonstrate your understanding of the potential value of dark data and its implications for business decision-making by creating a white paper that explores these concepts.
Browse courses on
Data-Driven Decision-Making
Show steps
-
Research the benefits and challenges of dark data
-
Develop a framework for extracting value from dark data
-
Provide case studies or examples of successful dark data utilization
Dark Data Visualization Dashboard
Show steps
Develop a comprehensive dashboard to visualize and interpret dark data effectively.
Browse courses on
Data Visualization
Show steps
-
Identify the key metrics and insights you want to communicate.
-
Design and implement a data visualization dashboard using appropriate tools.
-
Present your dashboard to stakeholders and gather feedback.
Seek guidance from a mentor in the field of dark data
Show steps
Connect with an experienced professional in the field of dark data for guidance and support, accelerating your learning and career growth.
Browse courses on
Mentorship
Show steps
Show steps
Show steps
- Establish regular meetings and seek advice
- Identify potential mentors
- Reach out and request mentorship
Review Data Modeling Techniques
Show steps
Refresh your understanding of data modeling concepts for effective dark data management
Browse courses on
Data Modeling
Show steps
Show steps
Show steps
- Review ER modeling and normalization techniques
- Practice designing data models for dark data scenarios
Connect with professionals in the field of dark data management
Show steps
Expand your professional network by attending events and connecting with individuals involved in dark data management, gaining insights and potential collaborations.
Browse courses on
Networking
Show steps
Show steps
Show steps
- Identify networking events or conferences
- Prepare an elevator pitch or brief introduction
- Attend the event and actively engage with others
14 other activities
Expand to see all activities and additional details
Show all 17 activities
Explore open-source tools for dark data analysis
Show steps
Familiarize yourself with open-source tools that can assist in dark data analysis, expanding your knowledge of practical techniques and technologies.
Show steps
Show steps
Show steps
- Identify and research open-source tools for dark data processing
- Install and configure the tools
- Follow tutorials or documentation to learn their functionality
Attend a Data Analytics Meet-up
Show steps
Network with professionals in the field and exchange ideas on dark data analytics.
Show steps
Show steps
Show steps
- Identify and attend a local data analytics or dark data management meet-up.
- Connect with other attendees and learn about their experiences and insights.
Attend a workshop on dark data management
Show steps
Participate in a workshop that provides hands-on experience with dark data management practices, enhancing your understanding of real-world implementation.
Browse courses on
Data Governance
Show steps
Show steps
Show steps
- Research and identify relevant workshops
- Register and attend the workshop
- Actively participate and engage with experts and peers
Practice sizing dark data
Show steps
Use a spreadsheet or other tool to estimate the size of dark data in an organization. This will help you understand the scale of the problem and the potential value of using dark data to create value.
Browse courses on
Dark Data
Show steps
Show steps
Show steps
- Identify the different types of dark data in an organization.
- Estimate the volume of each type of dark data.
- Calculate the total size of dark data in the organization.
Build a Dataset Inventory
Show steps
Create a comprehensive inventory to keep track of all dark data sources in your organization
Browse courses on
Data Management
Show steps
Show steps
Show steps
- Identify and classify data sources
- Document data lineage and relationships
- Establish data ownership and stewardship
Build a data pipeline to transform and enrich dark data
Show steps
Develop hands-on experience with building a data pipeline that can transform and enrich dark data, enhancing your understanding of the principles and techniques discussed in the course.
Browse courses on
Data Pipelines
Show steps
Show steps
Show steps
- Design the pipeline architecture
- Implement data ingestion and transformation
- Enrich data with external sources
- Build a data visualization dashboard
Engage in peer-led discussions on dark data
Show steps
Foster deeper understanding and exchange ideas by participating in peer-led discussions on dark data, benefiting from multiple perspectives and collaborative problem-solving.
Show steps
Show steps
Show steps
- Identify a group of peers with similar interests
- Establish regular meeting times
- Prepare discussion topics and facilitate the sessions
Identify dark data opportunities
Show steps
Brainstorm a list of potential opportunities to use dark data to create value. This could include using dark data to improve decision-making, identify new customers, or develop new products.
Browse courses on
Dark Data
Show steps
Show steps
Show steps
- Review the different types of dark data in an organization.
- Identify the potential benefits of using dark data.
- Brainstorm a list of potential opportunities to use dark data to create value.
Data Transformation and Enrichment Exercises
Show steps
Improve your data manipulation and enrichment skills for dark data analysis.
Browse courses on
Data Transformation
Show steps
Show steps
Show steps
- Work through the provided data transformation exercises in the course.
- Find additional datasets and practice data transformation and enrichment techniques.
Data Cleaning and Transformation Challenges
Show steps
Practice resolving common data quality issues encountered in dark data
Browse courses on
Data Cleaning
Show steps
Show steps
Show steps
- Handle missing values and outliers
- Standardize and harmonize data formats
- Apply data transformations and aggregations
Solve dark data analysis challenges
Show steps
Engage in practical exercises designed to improve your ability to analyze and interpret dark data, applying the concepts and techniques covered in the course.
Browse courses on
Data Interpretation
Show steps
Show steps
Show steps
- Identify and analyze dark data sources
- Extract meaningful insights from unstructured data
- Develop visualization techniques to present findings
Design a Data Visualization Dashboard
Show steps
Develop a dashboard that visually represents dark data insights to aid decision-making
Browse courses on
Data Visualization
Show steps
Show steps
Show steps
- Identify key metrics and KPIs
- Select appropriate visualization techniques
- Design and implement the dashboard
Write a white paper on the value of dark data
Show steps
Demonstrate your understanding of the potential value of dark data and its implications for business decision-making by creating a white paper that explores these concepts.
Browse courses on
Data-Driven Decision-Making
Show steps
Show steps
Show steps
- Research the benefits and challenges of dark data
- Develop a framework for extracting value from dark data
- Provide case studies or examples of successful dark data utilization
Dark Data Visualization Dashboard
Show steps
Develop a comprehensive dashboard to visualize and interpret dark data effectively.
Browse courses on
Data Visualization
Show steps
Show steps
Show steps
- Identify the key metrics and insights you want to communicate.
- Design and implement a data visualization dashboard using appropriate tools.
- Present your dashboard to stakeholders and gather feedback.
Career center
Learners who complete Value Creation with Dark Data will develop knowledge and skills
that may be useful to these careers:
Data Scientist
Data Scientist
A Data Scientist leverages advanced statistical modeling and machine learning techniques to solve business problems. Value Creation with Dark Data will provide you with a solid grounding in the principles of dark data management and utilization. The course's emphasis on developing data-driven solutions aligns perfectly with the core responsibilities of a Data Scientist. By mastering the concepts taught in this course, you'll enhance your ability to extract valuable insights from complex and often hidden data sources.
Chief Data Officer
Chief Data Officer
A Chief Data Officer (CDO) is responsible for overseeing the organization's data strategy and ensuring the effective use of data. Value Creation with Dark Data will provide you with a comprehensive understanding of data management, data governance, and data analytics. The course's focus on developing data-driven strategies and creating value from data will equip you with the skills necessary to succeed as a CDO. This course is highly recommended for individuals aspiring to leadership roles in the field of data management.
Data Protection Officer
Data Protection Officer
A Data Protection Officer (DPO) is responsible for ensuring the organization's compliance with data protection regulations and protecting the privacy of individuals. Value Creation with Dark Data will provide you with a deep understanding of data protection principles and best practices. The course's emphasis on data privacy, data security, and data ethics will equip you with the skills necessary to succeed as a DPO. This course is highly recommended for individuals aspiring to leadership roles in the field of data protection.
Data Privacy Officer
Data Privacy Officer
A Data Privacy Officer (DPO) is responsible for ensuring the organization's compliance with data privacy regulations and protecting the privacy of individuals. Value Creation with Dark Data will provide you with a deep understanding of data privacy principles and best practices. The course's emphasis on data protection, data security, and data ethics will equip you with the skills necessary to succeed as a DPO. This course is highly recommended for individuals aspiring to leadership roles in the field of data privacy.
Data Ethics Officer
Data Ethics Officer
A Data Ethics Officer is responsible for ensuring that the organization uses data ethically and responsibly. Value Creation with Dark Data will provide you with a deep understanding of data ethics principles and best practices. The course's emphasis on data privacy, data security, and data governance will equip you with the skills necessary to excel in this role. This course is highly recommended for individuals seeking to advance their careers in the field of data ethics.
Data Analyst
Data Analyst
A Data Analyst gleans insights from data. This role calls for expertise in an array of data mining and statistical analysis techniques. The course Value Creation with Dark Data will help you build a foundation in identifying, extracting, and using dark data to drive innovation and add value to the organization. The course's focus on creating actionable insights from data is highly relevant to the responsibilities of a Data Analyst.
Data Engineer
Data Engineer
A Data Engineer designs, builds, and maintains data pipelines and infrastructure. Value Creation with Dark Data will provide you with a comprehensive understanding of data management and transformation techniques. The course's emphasis on data quality and data governance will equip you with the skills necessary to ensure the integrity and reliability of data, a critical aspect of data engineering. By taking this course, you'll gain a competitive edge in the field of Data Engineering.
Data Science Manager
Data Science Manager
A Data Science Manager leads and manages a team of data scientists and engineers. Value Creation with Dark Data will provide you with a comprehensive understanding of data science principles and best practices. The course's emphasis on data management, data analysis, and machine learning will equip you with the skills necessary to excel in this role. This course is highly recommended for individuals seeking to advance their careers in the field of data science management.
Data Architect
Data Architect
A Data Architect designs and implements data management strategies and solutions. Value Creation with Dark Data will provide you with a deep understanding of data architecture principles and best practices. The course's emphasis on data modeling, data integration, and data governance will equip you with the skills necessary to design and manage scalable and efficient data architectures. This course is highly recommended for individuals seeking to advance their careers as Data Architects.
Information Security Analyst
Information Security Analyst
An Information Security Analyst protects an organization's information systems and data from unauthorized access, use, disclosure, disruption, modification, or destruction. Value Creation with Dark Data will provide you with a comprehensive understanding of data security principles and best practices. The course's emphasis on data protection, data encryption, and data recovery will equip you with the skills necessary to excel in this role. This course is highly recommended for individuals seeking to advance their careers in the field of information security.
Data Governance Specialist
Data Governance Specialist
A Data Governance Specialist develops and implements policies and procedures to ensure the integrity, security, and compliance of data. Value Creation with Dark Data will provide you with a comprehensive understanding of data governance principles and best practices. The course's focus on data quality, data security, and data privacy will equip you with the skills necessary to excel in this role. This course is highly recommended for individuals seeking to advance their careers in the field of data governance.
Privacy Analyst
Privacy Analyst
A Privacy Analyst is responsible for assessing and mitigating privacy risks within an organization. Value Creation with Dark Data will provide you with a deep understanding of data privacy principles and best practices. The course's emphasis on data protection, data security, and data ethics will equip you with the skills necessary to excel in this role. This course is highly recommended for individuals seeking to advance their careers in the field of privacy.
Business Intelligence Analyst
Business Intelligence Analyst
A Business Intelligence Analyst is responsible for transforming raw data into actionable insights that inform business decisions. Value Creation with Dark Data will equip you with the knowledge and skills necessary to identify and harness dark data, a valuable but often overlooked source of business intelligence. The course's focus on developing data-driven strategies will help you excel in this role, enabling you to drive informed decision-making and improve business outcomes.
Business Analyst
Business Analyst
A Business Analyst identifies and analyzes business needs and develops solutions to improve business outcomes. Value Creation with Dark Data will provide you with a solid foundation in data analysis and problem-solving techniques. The course's emphasis on using data to drive decision-making will enhance your ability to develop effective business solutions. By taking this course, you'll gain a competitive edge in the field of Business Analysis.
Machine Learning Engineer
Machine Learning Engineer
A Machine Learning Engineer develops and deploys machine learning models to solve real-world problems. Value Creation with Dark Data will help you build a foundation in data preparation, feature engineering, and model evaluation. The course's focus on using machine learning techniques to extract insights from data will enhance your ability to develop and implement effective machine learning solutions. This course is highly recommended for aspiring Machine Learning Engineers looking to gain a competitive edge in the field.
For more career information including salaries, visit:
OpenCourser.com/course/ddehpg/value
Reading list
We've selected 11 books
that we think will supplement your
learning. Use these to
develop background knowledge, enrich your coursework, and gain a
deeper understanding of the topics covered in
Value Creation with Dark Data.
Save
Offers a comprehensive overview of data strategy and its implications for businesses. It is particularly relevant for those seeking to develop a data-driven strategy for their organization.
Provides a gentle introduction to artificial intelligence. It is particularly suitable for those who are new to the field of AI but are interested in learning more about its applications.
Provides a practical introduction to machine learning. It is particularly valuable for those seeking to build a foundation in machine learning concepts and techniques.
Save
Provides a comprehensive overview of deep learning. It is particularly suitable for those who have a strong foundation in machine learning and are interested in exploring deep learning techniques.
Provides hands-on experience with machine learning using popular libraries such as Scikit-Learn, Keras, and TensorFlow. It is particularly valuable for those seeking to apply machine learning techniques to real-world problems.
Provides a comprehensive overview of natural language processing. It is particularly valuable for those seeking to develop a strong foundation in NLP concepts and techniques.
Provides a comprehensive overview of speech and language processing. It is particularly valuable for those seeking to develop a strong foundation in speech and language technologies.
Save
Provides a comprehensive overview of computer vision. It is particularly valuable for those seeking to develop a strong foundation in computer vision concepts and techniques.
Save
Provides a comprehensive overview of data mining. It is particularly valuable for those seeking to develop a strong foundation in data mining concepts and techniques.
Provides a comprehensive overview of database systems. It is particularly valuable for those seeking to develop a strong foundation in database concepts and techniques.
Provides a comprehensive overview of information retrieval. It is particularly valuable for those seeking to develop a strong foundation in information retrieval concepts and techniques.
For more information about how these books relate to this course, visit:
OpenCourser.com/course/ddehpg/value
Share
Similar courses
Here are nine courses similar to
Value Creation with Dark Data.
Dark Data Basics - Understanding the Unknown
OpenCourser.com/course/0z7tgp/dark
Dark Data Basics - Understanding the Unknown
Extracting Value from Dark Data: ULEADD
OpenCourser.com/course/swn59g/extracting
Extracting Value from Dark Data: ULEADD
Digital Forensics Essentials (DFE)
OpenCourser.com/course/fwpmdf/digital
Digital Forensics Essentials (DFE)
Philosophy and the Sciences: Introduction to the Philosophy of Physical Sciences
OpenCourser.com/course/o2tzmn/philosophy
Philosophy and the Sciences: Introduction to the...
Data Science in the Games Industry
OpenCourser.com/course/egvcn3/data
Data Science in the Games Industry
From the Big Bang to Dark Energy
OpenCourser.com/course/nl9gbu/from
From the Big Bang to Dark Energy
Advanced Reusable Styles and Themes in WPF
OpenCourser.com/course/9buq2y/advanced
Advanced Reusable Styles and Themes in WPF
Global Financial Markets and Instruments
OpenCourser.com/course/u5lze1/global
Global Financial Markets and Instruments
Exploring Data Transformation with Google Cloud
OpenCourser.com/course/k066fh/exploring
Exploring Data Transformation with Google Cloud
Level
Introductory
Via
Coursera
Institution
Arizona State University
Instructor
Curtis Thompson
Language
English
This course belongs to a
collection
called
Dark Data Migration and Architecture. It's comprised of three courses:
- Dark Data Basics - Understanding the Unknown
- Value Creation with Dark Data (viewing)
- Extracting Value from Dark Data: ULEADD
Good to know
Provides a practical approach to data analytics
Suitable for individuals seeking to develop analytical skills
Our mission
OpenCourser helps millions of learners each year. People visit us to learn workspace skills, ace their exams, and nurture their curiosity.
Our extensive catalog contains over 50,000 courses and twice as many books. Browse by search, by topic, or even by career interests. We'll match you to the right resources quickly.
Find this site helpful? Tell a friend about us.
Affiliate disclosure
We're supported by our community of learners. When you purchase or subscribe to courses and programs or purchase books, we may earn a commission from our partners.
Your purchases help us maintain our catalog and keep our servers humming without ads.
Thank you for supporting OpenCourser.
© 2016 - 2024 OpenCourser