Save for later

Big Data for Agri-Food

Demystify complex big data technologies

The sheer volume of a typical data set doesn’t fit on even the largest computer. And the tools that can handle big data seem too complex to grasp. To tackle these challenges, principles – such as immutability and pure functions – will help you understand big data technology. This makes big data management accessible, regardless of the programming language.

Specifically, should you scale up or scale out, how do you process big data stacks with map-reduce, using clusters, etc. In short, learn to recognise and put into practice the scalable solution that’s right for your situation. To illustrate, we will use current tools – such as Hadoop HDFS and Apache Spark – on user-friendly, hands-on examples from the agri-food sector. However, these principles can also be applied to other sectors.

Complexity of data collection and processing

Agri-food deserves special focus when it comes to choosing robust commercial data management technologies due to its inherent variability and uncertainty. Ranked the #1 university in Animal Sciences and Agriculture, Wageningen University & Research specialises in the interdisciplinarity between its knowledge domain of healthy food and living environment on the one hand and data science, artificial intelligence (AI) and robotics on the other.

Combining data from the latest sensing technologies (e.g. weather data) with machine learning/deep learning methodologies, allows us to unlock insights we didn’t have access to before. In the areas of smart farming and precision agriculture this allows us to:

Better manage dairy cattle by combining animal-level data on behaviour, health and feed with milk production and composition from milking machines.

Reduce the amount of fertilisers (nitrogen), pesticides (chemicals) and water used on crops by monitoring individual plants with a robot or drone.

More accurately predict crop yields on a continental scale by combining current with historic data on soil, weather patterns and crop yields.

In short, big data will allow us to bring forth effective solutions for smarter, innovative products. The possibilities are seemingly endless!

For whom?

You are a manager or researcher with a big data set on your hands, perhaps considering investing in big data tools. You’ve done some programming before, but your skills are a bit rusty. You want to learn how to effectively and efficiently manage very large datasets. This course will enable you to see and evaluate opportunities for the application of big data technologies within your domain. Enrol now.

This course has been partially supported by the European Union Horizon 2020 Research and Innovation program (Grant #810 775, “Dragon”).

What you'll learn

  • Recognize big data characteristics (volume, velocity, variety, veracity)
  • The difference between scaling up and scaling out
  • Big data principles: immutability and pure functions
  • Processing big data with map-reduce, using clusters
  • Understand technologies: distributed file systems, Hadoop
  • How dataframes and wrapper technology (Apache Spark) make life easier
  • The big data workflow and pipeline
  • How data is organized in datalakes, using lazy evaluation
  • Develop insight how to apply this to your own case

Get Details and Enroll Now

OpenCourser is an affiliate partner of edX and may earn a commission when you buy through our links.

Get a Reminder

Send to:
Rating Not enough ratings
Length 6 weeks
Effort 6 - 10 hours per week
Starts On Demand (Start anytime)
Cost $169
From Wageningen University & Research via edX
Instructors Ioannis N. Athanasiadis, Sjoukje Osinga, Christos Pylianidis
Download Videos On all desktop and mobile devices
Language English
Subjects Data Science
Tags Data Analysis & Statistics

Get a Reminder

Send to:

Similar Courses

Careers

An overview of related careers and their average salaries in the US. Bars indicate income percentile.

Volunteer Big Data Engineer $48k

Data Scientist - Big Data $68k

Big Data and AWS Data Lake $73k

Big Data Developer (Streaming Data) $77k

Big data developer with AWS $78k

Research Scientist Big Data $94k

Big Data Developer Consultant $98k

Big Data Engineer 6 $107k

Big data and ETL specialist $121k

Big Data Specialist $149k

Principal Big Data Architect $180k

Senior Big Data Sales $181k

Write a review

Your opinion matters. Tell us what you think.

Rating Not enough ratings
Length 6 weeks
Effort 6 - 10 hours per week
Starts On Demand (Start anytime)
Cost $169
From Wageningen University & Research via edX
Instructors Ioannis N. Athanasiadis, Sjoukje Osinga, Christos Pylianidis
Download Videos On all desktop and mobile devices
Language English
Subjects Data Science
Tags Data Analysis & Statistics

Similar Courses

Sorted by relevance

Like this course?

Here's what to do next:

  • Save this course for later
  • Get more details from the course provider
  • Enroll in this course
Enroll Now