This article introduces the features, benefits of implementation, and evaluation/development environment of Altera FPGA solutions provided for NVIDIA Holoscan Sensor Bridge (HSB).
For an overview of NVIDIA Holoscan and Holoscan Sensor Bridge, please refer to the article below.
Benefits of using Altera® FPGAs in HSB
1. High-speed sensor data processing
Altera® FPGAs can preprocess large amounts of sensor data in real time. By avoiding the transfer of unnecessary data to the GPU, they contribute to improved overall system efficiency.
2. Low latency and real-time capabilities
3. Compatibility with NVIDIA Holoscan
4. Flexible sensor interface
Altera® FPGAs support a variety of interfaces, including the following:
・MIPI, LVDS, JESD, Ethernet, SLVS-EC, etc.
One advantage is that future sensor changes can be easily handled by rewriting the FPGA.
5. Reduce GPU load
In an HSB configuration, the following processes can be performed on the FPGA side, allowing the GPU to be focused on AI inference processing and improving the overall system processing efficiency.
Filtering, ROI extraction, format conversion, timestamping, data compression/reduction
6. Future prospects and product roadmap
Altera®'s Agilex ™ FPGA series offers high scalability as an HSB platform for edge AI, medical, and robotics applications.
・PCIe Gen4
• High-speed Ethernet (10GbE to 400GbE)
Arm-based SoC FPGA
・Long-term supply
HSB development kit
HSB development kits require "expandability to capture various sensor inputs" and "communication performance that supports high-speed Ethernet."
If your development kit is equipped with an FMC connector, you can easily expand the necessary interfaces by connecting an FMC-compatible daughter card.
Stratix 10 Sensor Processing Kit
Atum A5 Development Kit
1. Equipped with Agilex 5 FPGA (A5ED065BB32AE4S)
2. Equipped with one QSFP+ 40GbE port.
- Reduces CPU load when combined with NVIDIA GPUDirect RDMA
3. Standard-equipped with the necessary I/F for HSB.
・MIPI connector ×2
・PCIe Gen3 x4
・HDMI
・2.5GbE Ethernet
4. Connect a daughter card to expand I/O.
• FMC+ compatible
Reference material
- Holoscan Sensor Bridge: Supporting the Era of Physical AI
- Holoscan 100G Sensor Bridge Solutions
- Holoscan Sensor Bridge MIPI to 10GbE System Example Design for Agilex™ 5 Devices
- Altera 25G Holoscan Sensor Bridge Demonstration (Video)
- Terasic Holoscan Sensor Bridge Solutions (10G–200G) (Terasic website)
- NVIDIA Holoscan Sensor Bridge (NVIDIA website)
Inquiry
If you are considering developing FPGAs for Holoscan Sensor Bridge, please feel free to contact us.
We provide support from development kit selection and reference design to evaluation environment setup.