Digital Orchard

Digital Orchard

Towards an Autonomous Pruning Robot

The research program ‘Digital Orchard’ focuses on the development of sensor technologies and digital applications that enable smart precision agriculture for the fruit sector.

Managing fruit orchards in a smart and sustainable way is challenging because tree maintenance is labor-intensive and requires the right expertise. Finding suitable labor is becoming an increasing challenge for the fruit sector. Therefore, the importance of using smart autonomous field robots in commercial orchards is increasing worldwide.

Autonomous management of fruit orchards

Robotization of fruit cultivation mainly focuses on labor-intensive tasks such as fruit picking, tree pruning, or blossom thinning. It can be particularly challenging to work in an orchard due to the complexity of the environment, where the fruit is often hidden behind leaves and not immediately visible. Furthermore, the impact of decisions like pruning may only become apparent in the future, with growth, bloom, and fruit set.The latest orchards are designed and planted to be suitable for future robotization. OnePlanet Research Center follows these developments and investigates in the research program ‘Digital Orchard’, which sensors and image processing systems are needed on a robot platform in the outdoor environment, for continuous data and image collection in the orchard of the future.

LiDAR scanners and stereo cameras

OnePlanet Research Center, in collaboration with various partners, is developing sensor fusion systems that combine images from LiDAR scanners, stereo cameras, and hyperspectral cameras. In this way, OnePlanet captures images of fruit trees in three dimensions and can digitally reconstruct individual trees based on the 3D images. These 3D reconstructions form the basis for recognizing structures and deviations (fruit, leaf, blossom, branches, insects) and for teaching tasks (picking, pruning, thinning, spraying) to future robot systems.

Spiral with: sense-digitize-analyse-apply

Digital twin of the orchard

The data and images are combined with knowledge of plant models and form the basis for building a digital orchard (a digital twin). They can also be used for educational purposes in VR applications, in which the user can practice and learn tasks in a virtual 3D environment. Future robotization tasks that OnePlanet is working on include autonomously pruning fruit trees (apple and red currant bushes) and better recognizing diseases and insect pests in pears.

Application-driven research with robotics

In addition to technical feasibility, the future acceptance and implementation of robots or cobots in future cultivation systems, require careful choices regarding practical applicability, safety, and ultimate costs. By seeking the right collaborations, OnePlanet Research Center tries to ensure those practical conditions in its research and development activities.

The Mood & Eating Behavior project at OnePlanet Research Center investigates the link between mood and eating behavior. The long-term objective is to get insights in the link between mood and eating behavior to assist people with just-in-time-adaptive-interventions to enhance mood and improve their health.

Smart SnackBox

The smart SnackBox is a tool, developed at OnePlanet Research Center, to assess dietary consumption. The emphasis is on drinks and snacks that you consume between meals. This is also referred to as snacking behavior in everyday life.

In the Netherlands, we see that on average 30% of the daily caloric intake is coming from snacking. For overweight adults this can even be around 50%. Besides the obvious relationship between snacking behaviour and physical health, snacking has a particular strong connection to mental health as well. Where hunger is often the key factor in the quantity of consumption for meals, for snacking this is mood and mental well-being.

Studies caloric intake from snacking

There are quite a few laboratory studies that show that moods influence calorie intake through snacks. Moods like sadness or stress influence snack behaviour. With the smart SnackBox, OnePlanet was able to replicate these findings in a natural setting, at work or at home.

Besides the relationship with mood, the accuracy in time of the SnackBox also enables investigating the relationship between snacking and physiology in natural settings, using wearable data as additional input here.

Mapping these relationships helps in:

  1. understanding decision making and impulse control related to snacking behavior on group level.
  2. predicting future snack events on individual level.

The latter could also help the user by inducing just-in-time adaptive interventions and increasing self-awareness. This feedback-loop has proven to be effective in other lifestyle intervention programs on for example stress, and the smart SnackBox allows us to apply that framework to snacking behavior.

 

The world’s population is growing exponentially. Precision agriculture running on integrated photonics is helping to keep our food supply safe and sustainable in the long term.

OnePlanet Research Center Introduces OpenPlanet; An accessible digital environment for entrepreneurs and organizations in health, agriculture and food.

OpenPlanet is an accessible digital ecosystem for entrepreneurs and organizations in health, sustainable agriculture and food. It is a secure data & application environment in which data is collected, analyzed and shared. OpenPlanet aims to provide an answer to the current fragmentation of solutions and the lack of knowledge to effectively convert data into insights and digital services. OpenPlanet offers users the opportunity to share and enrich relevant data for end-user applications across application domains. it also provides an environment for developing advanced algorithms and models.

Imagine if there was one open, secure data & application environment for companies and organizations working in the fields of sustainable agriculture, food and health?

The platform consists of applications for data collection (sensors, apps, links with various data sources), data connectivity (sensor network, digital infrastructure), data storage and analysis (AI, digital twins), a marketplace for algorithms and applications for action perspective, support and feedback to end-users (apps, dashboards). For example, data from wearables can be shared live between doctor and patient, or data from sensors can be used to optimize real-time processes in agriculture.

OpenPlanet is a collaborative project of OnePlanet Research Center, Orikami, IVIDO, JoinData, and SIDN. OpenPlanet has received a REACT-EU contribution from East Netherlands. With this, Europe is investing in the provinces of Overijssel and Gelderland in a rapid economic recovery after COVID-19.

This is a contribution that is in line with the priorities of the province of Gelderland: “The build-up of the data ecosystem and associated activities are aimed at green, digital and resilient recovery of the economy through economic structure strengthening through targeted investments in facilities and valorization activities that aim to give SMEs the opportunity to develop new ideas and products. test, develop and scale up in an accessible way’. – Province of Gelderland

Know more about OpenPlanet?

Jacob Beeuwkes, Program manager OpenPlanet Program – OnePlanet Research Center 

Jacob.Beeuwkes @imec.nl

Together with key partners, OnePlanet Research Center is using the newest technology innovations to tackle problems in supply chains of perishable food products. Our goal is  to improve product quality and reduce greenhouse gas emissions and food waste with sensing and digital twin technology. The innovative sensor systems and the digital twins results in real-time status information and decision support. This opens possibilities for advanced quality-based control allowing for more efficient food chains with better matching supply and demand, more insight in the quality of the food products and less food waste. 

Imagine that.. we could use sensors and digital twins to improve the quality of perishable food products, while at the same time reduce greenhouse emissions and food waste!

To make a real impact within this domain, it is key to establish real-time access to supply chain conditions and product information in each stage of the supply- and production chain. OnePlanet Research Center is exploring the use of (i) advanced IoT sensor systems to monitor products in the supply chain,(ii) real-time data access and data integration to create the full picture of what is going on in the supply chain, and (iii) relevant models that allow for prediction of product characteristics at each moment of its lifetime.

With these elements in place, a digital twin of the product in the food supply chain can be created and continuously updated. The digital twin will allow for simulation of future behaviour in various scenarios, and thereby enables chain actors to make optimal decisions at each moment in time.

Two prototypes of a digital twin will be developed:

  1. The digital twin of the fresh supply chain, in which the emphasis lies on the long transportation and quality development of tropical fruits, such as bananas or avocados, and on non-destructive quality sensing of glasshouse vegetables such as tomatoes.
  2. And the digital twin of the meat production chain, in which the emphasis lies on individual quality monitoring of carcasses.

This work is done in a close collaboration between system and data integrators, sensor developers, use case partners and research institutes Wageningen Research and Imec as part of their collaboration in the OnePlanet Research Center initiative. OnePlanet is an innovation center for chip and digital technology in agri, food, health and environment. It is a collaboration between nano-technology R&D institute imec, Radboud University, Radboudumc and Wageningen University & Research.

This collaboration is a great example of how digital transformation can be applied in practice and have both economic and societal impact by reducing food waste, increasing product quality, reducing greenhouse gas emission, and increasing the profitability of the food chains.

Smart, sensor-based solutions will be a big step towards ultra-controlled greenhouse production that, in turn, will be a milestone in Indoor Autonomous Farming. The innovations developed will provide farmers and greenhouse management companies new opportunities for sustainable food production.

If we had the tools to fully automate crop cultivation in greenhouses, non-specialized workers would be able to perform basic greenhouse-management tasks, and enable professional practitioners and commercial greenhouse management companies to work more efficient, freeing them from repetitive and heavy labor. It would deliver farmers and plant scientists new insights to optimize plant health and production yields, and thus opportunities to make food production more sustainable. And it would allow food to be produced in urban locations, particularly where there is limited space, shortening the distance between producer and consumer.

Sensor-based, smart solutions

In Indoor Autonomous Farming, OnePlanet Research Center is developing a 3D sensor-based monitoring network and an integrated data platform that opens the way to autonomous greenhouse production and, in the longer term, fully-controlled vertical farming systems. The system might combine, for example, cameras measuring leaf temperature (an indicator of respiration) with RGB cameras that give insight into nutrient deficiencies and the early onset of plant diseases, and a whole range of other sensors throughout a greenhouse.

Conventionally, growth conditions are measured at only one location in the greenhouse. Sensors at different locations will provide farmers and greenhouse specialists additional insight into how a greenhouse functions – for example whether windows are opened and closed correctly, or whether the heating pipes are doing their job – and how plants respond to growth conditions in real time.

In this program, OnePlanet combines its expertise on high-tech sensors with a deep understanding of data-sciences, machine-learning, agriculture and food to address the complex issues that inevitably accompany radical innovation. How to combine and integrate the output of sensors located in different positions in a greenhouse, and how to link them, in real-time, with data on plant health? What kind of electronics will be durable and reliable in humid greenhouse conditions and will they need special protection? Novel sensors developed in another OnePlanet program, Emerging Sensing, will be validated in indoor farms, and linked to crop data in order to create models for improving crop health, yield and use of resources in indoor settings.

Towards an online platform

AGROS, the first research program in this innovation line, kicked-off in May 2020, funded by two Dutch Topsectors and with over 26 private partners. Cucumber plants are the first crop to be cultivated, using a smart sensor network prototype that includes measurement of greenhouse atmosphere and humidity, and thermal and hyperspectral imaging that provides pictures of individual plant health. First measurement outcomes using the sensor protoype show agreement with reference sensors. By 2026, the data collected will be integrated into an online platform that allows autonomous control of greenhouse climate and fertigation.

How to warn people at an early stage that they have Parkinson’s or Alzheimer’s? Or that the disease is progressing? And how can we then optimally support them in their daily lives, so that they gain more control over the course of their disease? In the ICAI lab AI for Risk Profiling and Decision Support (AI-RONDO) researchers use artificial intelligence to enable early detection and personalized feedback.

Parkinson’s and Alzheimer’s cannot (yet) be cured, but it is possible to optimize the daily functioning of people with these conditions. By taking preventive measures at an early stage and slowing down the process. To make this possible, Radboud University, Radboudumc and imec in OnePlanet Research Center, together with industry and societal institutions, are joining forces in the ICAI lab AI-RONDO, focusing on two pillars:

  • Mapping the risks of Parkinson’s and Alzheimer’s disease at an early stage (risk profiling)
  • Providing additional and personalized support to people who have the diseases (decision support)

Risk profiling

There is already a lot of data on patients suffering from Parkinson’s and Alzheimer’s. By using AI algorithms and models on this information, new links can be found and for example groups facing an increased risk of developing complications can be pinpointed. Using these enriched data it is possible, following diagnosis, to prescribe treatment for a patient specifically designed for their personal risk profile. The signs – such as speaking more softly, articulating less clearly, a change in walking patterns or heart rate – that indicate that something is going wrong, can be analyzed. On the basis of a sign like this, a care provider can prevent further deterioration.

Decision support

AI-RONDO will use digital tools to collect data in the home situation and to provide the patient with personalized feedback. For example an app linked to a bracelet that provides an analysis of how symptoms changed over the course of the day, linked to the taking of medication. Or an avatar, a virtual assistant that engages in conversation with the patient while simultaneously collecting new data on the progression of the disease from their speech. This extra support – in addition to regular care – offers patients more information on and a greater understanding of their own health. This means they have greater control and are able to delay the disease’s progress themselves.

A real-life digital measurement and monitoring platform for the (mental) well-being of citizens and special risk groups. That’s what Noldus, Ivido and OnePlanet Research Center will develop in this EFRO funded project.

Physiological measurements, like heart rate and heart rate variability, can provide insights in peoples (mental) health. These insights allow us to do early risk assessments and lifestyle and behavioral interventions. Nowadays, these measurements are mostly performed in lab environments with dedicated tools. Data from real life environments are more relevant, but current health monitoring wearables can only provide a limited amount of information. Therefore, Noldus, Ivido and OnePlanet will further develop the Chill+, a (mental) health monitoring wearable, and perform these real-life digital measurements.

Towards prevention

Also, the research team will build a software platform for analysis of both raw and processed physiological data. Ultimately, a personalized health dashboard will be developed for visualization of the data from the Chillband+. This platform provides insight in risk factors, efficiency of behavioral interventions and optimization of mental health and well-being. Data from the platform will become available for patients, healthy people, health care professionals and researchers. Taken together this should aid the healthcare transition towards remote healthcare and personal preventive health.

This innovation is funded by EFRO: European Fund for Regional Development in the European Union.

Digitizing agriculture to improve the yield of potatoes and lowering emissions and water usage. That’s the main goal of this research project. The research team is developing new methods for below and above ground sensing and multiple techniques, like radar, x-ray, hyperspectral imaging and impedance tomography.

The project was initiated by Wageningen University and Research and NARO, the Japanese National Agriculture and Food Research Organization.

Researcher Jan Willem de Wit explains the TTADDA project in the field:

To improve lifestyle recommendations, we need to learn what works particularly for one person and what doesn’t. Since everybody has different genetics, health status, activity levels and environments. Artificial intelligence (AI) can help us here. In the ICAI Lab researchers aim to increase the quality and quantity of health, dietary and behavioral data and to develop AI algorithms and models to improve personalized lifestyle feedback.

Learn more about the Lab team and the Lab partners

What if … we can give more accurate personalized advice on diet and healthy lifestyle with help from artificial intelligence?

A smart bathroom that non-invasively and regularly measures and integrates blood pressure, hydration status and other health biomarkers to provide people with personalized feedback, is the exciting goal of Smart Bathroom for Health. The technology can serve as a research platform to collect objective health data at home and contribute to new (dietary) interventions and early detection of diseases.

What if… we could detect early markers of disease and develop personalized nutrition, lifestyle and medical interventions, without the need for hospital visits and time-consuming, often uncomfortable, manual measurements of bodily functions?

Measuring physiological indicators such as blood pressure and hydration status multiple times a day would allow for early detection and, possibly, prevention of diseases. Variations in blood pressure and oxygen levels can be early signs of cardiovascular diseases. Urine protein levels and fecal inflammatory markers give insight into urinary and gastrointestinal health. And gradual weight loss can go unnoticed, but might point to poor nutrition.

Advanced sensors

In Smart Bathroom for Health, OnePlanet Research Center aims to develop a variety of advanced sensors for measuring health: integrated in and around the toilet, the mirror, etc. These sensors will connect to a digital platform that interprets these data, identifying trends, predicting health issues and giving personalized advice.

Experts from imec, a specialist in high-tech sensors and wearables, are collaborating closely with nutritionists and doctors from Wageningen University & Research, Radboud University and Radboudumc, to overcome the practical and technological challenges anticipated with such a disruptive innovation. They must, for example, select those biomarkers that are most reliable and representative for health. The technology should need minimal power, and be moisture-resistant.

Fundamental to the OnePlanet vision is to ensure what is developed makes a clear and measurable difference in real life. That’s why food, pharma and technology companies are invited to join the innovation process.

Towards personalized feedback

In 2019, the first prototype of a smart toilet – it measured an individual’s physiology – was tested among visitors to the Lowlands event in Biddinghuizen, the Netherlands. A second, optimized, prototype will be tested in Summer 2021, in volunteer’s homes. The next step will be to expand the system, adding sensors to measure hydration status and fecal markers of inflammation, as well as software and artificial intelligence solutions that allow for the generation of personalized feedback.

Citizen nutrition is a large personalized nutritional study in Gelderland, where new measurement techniques are being used and new behavioral intervention / models can be tested. The collected data enables the development of precision nutritional models and targeted personalized feedback.

The goal of this innovation trajectory is to set up a participatory study in which new measurement techniques, behavioral models and the development of precise nutritional models come together.

The goal is to create insights on effective interventions for person-oriented eating-behavior guidance, the development of associated employable technology and develop contributions to health interventions in personal living environments.

Screenshot 2020 11 18 At 16.28.10