Jiangsan Zhao
Research Scientist
Abstract
Neural Radiance Fields (NeRF) have been widely adopted for reconstructing high-quality 3D scenes from 2D RGB images. However, achieving accurate 3D object segmentation within these reconstructed scenes remains challenging. Existing NeRF-based segmentation methods either rely on post-processing (SA3D), which produces noisy point clouds due to the absence of density field optimization, or employ joint training with additional segmentation heads (FruitNeRF), which can lead to suboptimal performance due to conflicting learning objectives. In this work, we propose InvNeRF-Seg (Input-substitution NeRF for Segmentation), a two-stage fine-tuning strategy for 3D object segmentation that preserves the original NeRF architecture and loss function entirely. We first train a standard NeRF on RGB images and then fine-tune it using 2D segmentation masks formatted as RGB-like inputs, without introducing any architectural modifications or additional loss functions. This input-substitution approach reshapes the density field to align with object regions while suppressing background density. We validate InvNeRF-Seg through comprehensive ablation studies examining the roles of density and color MLPs, loss function choices, and training strategies. Field density analysis reveals consistent semantic refinement: densities of object regions increase while background densities are suppressed. Experiments on synthetic fruit datasets and real-world soybean imagery demonstrate that InvNeRF-Seg produces cleaner 3D segmented point clouds compared to both SA3D and FruitNeRF, enabling more accurate downstream object counting. The method is further validated on a self-collected soybean dataset to demonstrate its applicability in real-world agricultural scenarios.
Abstract
Abstract Single-date UAV vegetation indices are widely used to assess potato crop performance and estimate yield. However, whether their biological interpretation remains consistent across cultivars and growth stages is rarely examined. This study investigated how the relationships between UAV-derived multispectral and thermal canopy indicators and potato yield changed during crop development under contrasting irrigation in two cultivars with contrasting maturity classes (Anouk and Celandine). UAV surveys were conducted in July and August, and canopy metrics were related to final yield and tuber traits. The relationship between NDVI and yield differed markedly between cultivars and growth stages. In the early-maturing cultivar Anouk, July NDVI showed a strong positive correlation with yield ( r = 0.87, p = 0.002), whereas August NDVI was not informative. In the late-maturing cultivar Celandine, the relationship reversed from a positive correlation in July ( r = 0.56) to a strong negative correlation in August ( r = −0.80, p = 0.009), indicating that greater late-season canopy greenness was associated with lower yield. Exploratory LOOCV Random Forest models achieved the highest yield prediction accuracy using July features for Anouk ( R 2 = 0.72) and August features for Celandine ( R 2 = 0.47), while multi-temporal features provided similar predictive performance. Greater temporal declines in NDVI were associated with higher yield in both cultivars, consistent with the change in canopy greenness acting as a phenological indicator of the transition from vegetative growth to tuber bulking. These results demonstrate that the interpretation of UAV-derived vegetation indices is strongly dependent on cultivar maturity and growth stage. A single UAV acquisition may therefore provide misleading assessments of crop performance when canopy phenology is not considered. Rather than serving as fixed proxies for yield, canopy vegetation indices should be interpreted within cultivar-specific and temporal contexts when used for potato monitoring and agronomic decision-making.
Division of Food Production and Society
TEKNOPOTET – New technology for increased precision in production and storage of small-sized potatoes
The aim of project is to combine new tehnologies and knowledge about physiological status of potatoes to increase the precision of growing and storing of small-sized potatoes.
Division of Food Production and Society
Techgraze – Integrating Advanced Technologies for Enhanced Grazing Practices in Norway
In Norway, a declining grazing pressure and farm abandonment have led to undesirable ecological and socio-economic outcomes. The TechGraze project aims to address these challenges by integrating Virtual Fencing (VF) and Remote Sensing (RS) technologies to enhance pasture-based livestock management.