logiVIEW Datasheet
Contents
1. swizzled texture non square pixel size 27 05 2015 Pixel color calculation improved for YUV 4 2 2 added buffer registers and busy flag Copyright Xylon d o o 2001 2015 All Rights Reserved Page 10 of 102. Xylon s 1st GEN SV Xylon s 2nd GEN SV Planar Ground Surface Bowl Shaped Ground Surface Figure 6 The difference between the 1 and the 2 generation of Surround View ADAS To learn more about Xylon s Surround View ADAS please visit http www logicbricks com Solutions Xylon ADAS Development Kit aspx Example logiVIEW Application Multi Head 360 Video Camera for Surveillance Applications Video surveillance multi head camera with no blind spots that shows 360 view Panoramic View of the surroundings can be also based on the logiVIEW IP core Xylon s demo setup uses 3x 1MP Mega Pixel imagers with wide angle lenses and Xylon logiCRAFT CC development board based on Xilinx Spartan 6 FPGA to fully process captured video streams in real time Xylon logicBRICKS IP cores remove lens distortions fish eye make perspective corrections and seamless stitching of three video streams with no dividing borders and finally display the resulting panoramic 2D video image Figure 7 The difference between the Bird s View perspective and the Bowl View The demo can be upgraded to support much higher video camera resolutions To learn more about Xylon s Multi Head Panoramic Camera please visit http www logicbricks com Markets Industrial Video Surveillance Multi Head 360 Panoramic View Camera aspx Example logiVIEW Application Real time Low Latency Video Rotation Medical endoscopes pipe inspection tools o
3. ry video_out_curr_vbuff lt lt video_out_next_vbuff lt gt video_out_sw_vbuff J Output buffer video_out_sw_grant C AXI4 AXI or AXI4 STREAM Figure 1 logiVIEW Architecture Features cont e Supports native non swizzled video inputs and swizzled Xylon proprietary for the highest efficiency e Optional scaling only module that reduces required programmable resources e Supports line rendering default is tile rendering with AXI4 Stream output e Supports input output color spaces RGB RGB and YCbCr 4 2 2 YCbCr 4 2 2 e Double triple buffering of video inputs and triple buffering of video outputs prevent video flickering e Simple programming of control registers through ARM AMBA AXI 4 Lite interface e Configurable video memory interface type AMBA AXI4 or AMBA AX14 Stream e Prepared for Xilinx Vivado Design Suite implementation tool e Older IP core s versions available in the Xilinx ISE Platform Studio compatible format e Parametrical VHDL design that allows tuning of features set and consumption of FPGA resources e Simple Plug n Play other Xylon logicBRICKS IP cores such as logiWIN Versatile Video Input logiCVC ML Compact Multilayer Video Controller logiBITBLT Bit Block Transfer 2D Graphics Accelerator logilSP Image Signal Processing ISP Pipeline Applications e Automotive Driver Assistance Systems Surround View Pedestrian Detection L
4. 2001 2015 All Rights Reserved Page 8 of 10 logiVIEW Image Processor Data Sheet Version v3 11 Verification Methods The logiVIEW is fully supported by Xilinx Vivado IP Integrator and ISE Platform Studio integrated software solution This tight integration tremendously shortens IP integration and verification A full logiVIEW implementation does not require any particular skills beyond general Xilinx tools knowledge Recommended Design Experience The user should have experience in the following areas Xilinx design tools ModelSim Available Support Products logiREF logiVIEW ZC706 reference design showcases major logiVIEW IP features on Xilinx ZC706 Evaluation kit The demo is simple to use and works on a still test image stored on the SD card Demo users can program arbitrary test images i e image captured from the proprietary video camera Demonstrated features include homographic perspective transformation MLUT transformation lens correction and lens correction with perspective transformation This demo is available on request only Email info logicbricks com logiREF VROT FMC is a free and downloadable logicBRICKS reference design that showcases a real time video rotation for an arbitrary angle which can be dynamically changed in sub degree steps The video rotation works with a video output latency that can be as low as one frame time Designed by standard off the shelf evaluation logicBRICKS IP cores the demo SoC also d
5. Xilinx Zynq 7000 AP SoC based logiADAK Automotive Driver Assistance Development Kit Copyright Xylon d o o 2001 2015 All Rights Reserved Page 4 of 10 logiVIEW Image Processor Data Sheet Version v3 11 Figure 4 Xylon s Four Camera Surround View DA Demo System Camera Positioning and Example Video Outputs Bird s View Perspective The Surround View DA system uses at least 4 cameras furnished by extreme wide angle fish eye lenses which cover separated zones around the vehicle The logiVIEW must remove the lens distortions correct perspectives to four high resolution input video streams and stitch the corrected video images in a single display of vehicle s surroundings Figure 5 Xylon s Four Camera Surround View DA Demo System 3D View generated by logiVIEW MLUTs Configurable logiVIEW MLUTs enable development of new generation Surround View automotive systems with the 3D visualization of vehicle s surrounding The 3D visualization is achieved by projecting captured camera video images on the bowl shaped ground surface Figure 5 This type of visualization is more natural and easier to use While bird s eye surround view systems have the POV Point of View defined orthogonally above the vehicle new systems with the bowl view capability can show vehicle s surroundings from different POVs Copyright Xylon d o o 2001 2015 All Rights Reserved Page 5 of 10 logiVIEW Image Processor Data Sheet Version v3 11
6. a selection from a list of the available configuration parameters Table 2 logiVIEW VHDL configuration parameters Parameter Description C_USE_PT Use the Perspective Transformation block C_USE_LT Use the Lens Transformation block C_USE_MLUT Use the Memory Look up Table block C_USE_DCA Use the Dynamic calibration block Use Lens Transformation multiplexer enables switching the source for input C_USE_LT_COORD_MUX coordinates between Coordinate Generator and Perspective Transformation Copyright Xylon d o o 2001 2015 All Rights Reserved Page 7 of 10 logiVIEW Image Processor Parameter Description Data Sheet Version v3 11 block C_USE_TC_COORD_ MUX C_USE_IN_BUFF Use Perspective Transformation multiplexer enables switching the source for input coordinates between Coordinate Generator Coordinate Fetch Perspective Transformation or Lens transformation block Enables input image s buffering to prevent video flickering C_USE_OUT_BUFF Enables output image s buffering to prevent video flickering C_USE_YUV_4 2 2 Use YCbCr 4 2 2 format RGB is default C_CAMERA_NUM Number of input cameras The logiVIEW is designed with regard to adaptability to various SoC designs However there may be instances where source code modification is necessary Therefore if you wish to reach the optimal use of the logiVIEW core in your specific implementation or to supplement som
7. Merere Designed by XYLON logiVIEW Perspective Transformation and Lens Correction Image Processor May 27 2015 Xylon d o o Fallerovo setaliste 22 10000 Zagreb Croatia Phone 385 1 368 00 26 Fax 385 1 365 51 67 E mail support logicbricks com URL www logicbricks com Features e Supports Xilinx Zynq 7000 All Programmable SoC 7 Series and newer Xilinx FPGA families e Older Xilinx FPGAs supported by previous IP core versions e Supports perspective transformations of 2D quadrilaterals e Programmable homographic transformation matrix enables cropping resizing rotating translating arbitrary combination of above operations Data Sheet Version v3 11 Core Facts i Xilinx Vivado IP Integrator Application Notes reference design Additional Items Documentation Reference design for Xilinx ZC706 Evaluation Kit standalone and Linux SW drivers and libraries Simulation Tool Used Mentor Graphics Modelsim Support provided by Xylon e Supports arbitrary transformation functions defined by MLUTs Memory Look Up Table e Supports correction of fish eye lens distortions e Suitable for extreme wide angle lenses fish eye with Field Of View FOV gt 180 e High performance i e up to 94 Mpix s in 100 MHz operating systems e Supports up to 2048x2048 input and output resolutions 30 fps and higher frame rates e Configurable number of video inputs cameras and video outputs e
8. This module can be used to save FPGA resources when scaling is the only required transformation type The logiVIEW IP core configured with the Scaler module does not support lens and perspective transformations De interlacer The De interlacer module generates coordinates for progressive rendering of the interlaced video It uses video_in_odd_flag input signal to compensate image flickering between even and odd lines Texture Cache The Texture Cache block uses texture coordinates from the Lens Transformation Perspective Transformation Coordinate Fetch MLUT or Coordinate Generator no transformation to retrieve pixels from the original input image stored in memory Besides the pixel defined by input coordinates the Texture Cache block retrieves the nearest neighboring pixels and uses caching for efficient memory bandwidth usage logiVIEW Control The logiVIEW Control module fetches linked list elements from the memory and uses them to program all other logiVIEW modules The programming is executed in defined timing intervals Access to the memory is provided by the means of the 64 bit XMB or AXI4 bus Core Modifications The logiVIEW IP core is supplied in an encrypted VHDL format compatible with the Xilinx Vivado IP Integrator tool Older logiVIEW versions are available in the Xilinx ISE Platform Studio compatible format Different logiVIEW configuration parameters are selectable prior to VHDL synthesis and the following table presents
9. Video De interlacing e Supports square and non square pixels pixel aspect ratio at the video input Table 1 Example Implementation Statistics for Xilinx FPGAs Fmax MHz Slices Device mclk rclk FFs LUTs 2382 140 vw 7979 5138 2 Family Artix 7 XC7A35T 2 150 Kintex 7 2384 00 200 XC7K70T 3 7979 5136 ZYNQ 7000 2143 140 150 XC7Z010 2 7979 5136 1 Assuming the Automotive Surround View Driver Assistance DA system s configuration 4 input cameras 4 output images 32 bit AXI Lite register interface 64 bit AXI memory interface lens correction and perspective transformation YUV color space 2 Assuming register and memory interfaces are connected internally Copyright Xylon d o o 2001 2015 All Rights Reserved MULT DSP48 E Design Tools Vivado 2014 4 Vivado 2014 4 Page 1 of 10 logiVIEW Image Processor Data Sheet Version v3 11 logiVIEW AKI Logiview Control Registers AXI4 Coordinate Fetch Dynamic Calibration i ALU i rst gt clk start _ interrupt Texture LA Bilinear Cache my Interpolation video_in_curr_vbuff L video_in_next_vbuff lt lt video_in_sw_vbuff gt Coordinate Generator Perspective ansformatio video_in_sw_grant lt 4 Transformation video_in_odd_field cC De interlacer
10. ame memory subsystem SoC bus and memory controller IP core and the memory connected to the FPGA Video format can be setup through IP core s configuration GUI interface In video applications that require more processing power than offered by a single logiVIEW IP core instance it is possible to implement parallel processing of video inputs segments by multiple logiVIEW IP core instances and to achieve application goals The logiVIEW IP core uses linked list programming for maximum flexibility Descriptor a set of 32 words stored in memory contains all data required to initialize logiVIEW for one output view It has a programmable registers field accessible through the standard AMBA AX 4 Lite bus Video memory interface can be selected to support AMBA AXI4 or AX14 Stream bus interface Example logiVIEW Application Automotive Surround View Driver Assistance The Surround View DA provides an unmatched awareness of the situation by enabling the driver to see 360 degrees around the vehicle on the LCD instrument cluster or the Central information Display CID The surroundings can be seen from different perspectives including the bird s eye view perspective typical for the first generation systems which eliminates all blind spots during critical and precise maneuvers in crowded spaces Xylon s Surround View solution based on the logiVIEW IP core is today used on the road in production automotive systems The solution can be evaluated on the
11. and a full removal of all distortions in the picture s center Figure 3 The MLUT transformations are key logiVIEW IP core s features for 3D Surround View applications Figure 5 and 6 Copyright Xylon d o o 2001 2015 All Rights Reserved Page 3 of 10 logiVIEW Image Processor Data Sheet Version v3 11 Figure 3 Example MLUT Transformation The logiVIEW is a highly configurable IP core and can be used within Xilinx Vivado and ISE Design Suits Xilinx implementation tools enable easy tuning of the logiVIEW s consumption of programmable logic resources and the features set setup through an easy to use GUI interface Table 2 shows configuration parameters that can be setup prior to the core s synthesis time IP configurations which utilize only the perspective only the lens transformation or only MLUT transformation are good examples of balancing between the required features set and used programmable logic resources The logiVIEW can handle an arbitrary number of video inputs and video outputs as long as the system architecture allows it The available memory bandwidth frame rates of input video cameras and other system parameters determine the number of supported video inputs and outputs by a single logiVIEW IP core For example the YCbCr video format requires lower memory bandwidth than the RGB video format and the logiVIEW IP core configured to use the YCbCr can support more video channels and higher video resolutions with the s
12. ane Departure Warning Rear View Camera Heads Up display HUD e Industrial systems Surveillance Systems like Multi Head 360 Panoramic Wide Camera with no blind spots Industrial Pipe Inspection equipment Test equipment e Medical Endoscopy and similar equipment e Defense equipment etc Copyright Xylon d o o 2001 2015 All Rights Reserved Page 2 of 10 logiVIEW Image Processor Data Sheet Version v3 11 General Description The logiVIEW Perspective Transformation and Lens Correction Image Processor is Xylon s logicBRICKS IP core optimized for Xilinx Zyng 7000 All Programmable SoC and FPGAs and designed to real time process multiple still images or video streams The logiVIEW IP core removes fish eye distortions caused by extreme wide angle Field Of View FOV lenses makes perspective corrections and other homographic transformations to the captured video and executes arbitrary non homographic transformation functions defined by MLUTs Memory Look up Table The multiple corrected processed video or still image outputs can be stitched in a resulting single image by complementary logicBRICKS IP core the logiCVC ML Compact Multilayer Video Controller display controller IP core The logiVIEW can be configured to use only Perspective Transformation use only Lens Distortion Transformation use both Transformations Video image captured by wide Corrected distortions inserted OW lens by the lens PS SS SS eS eo eS
13. dditional information Email sales logicbricks com URL www logicbricks com Products logiVIEW aspx This publication has been carefully checked for accuracy However Xylon does not assume any responsibility for the contents or use of any product described herein Xylon reserves the right to make any changes to product without further notice Our customers should ensure that they take appropriate action so that their use of our products does not infringe upon any patents Xylon products are not intended for use in the life support applications Use of the Xylon products in such appliances is prohibited without written Xylon approval Related Information Xilinx Programmable Logic For information on Xilinx programmable logic or development system software contact your local Xilinx sales office or Xilinx Inc 2100 Logic Drive San Jose CA 95124 Phone 1 408 559 7778 Fax 1 408 559 7114 URL www xilinx com Revision History Version 04 06 2010 Preliminary Xylon release new doc template 03 03 2011 Changed data in the Table 2 Added description of new MLUT feature and YCrCB RGB converter 01 04 2011 The first public version Added short Calibration Software description 19 11 2012 Support for bowl shaped surface projections 3D visualization dynamic stitching new calibration software and the second generation logiVIEW SVK updated resources 18 03 2015 Initial Vivado version of IP core Support for non
14. e of your specific functions you can allow us to tailor the logiVIEW to your requirements Core I O Signals The core signals I O have not been fixed to specific device pins to provide flexibility for interfacing with user logic Descriptions of all signals I O are provided in Table 3 Signal Directi Table 3 Core I O Signals Description on Global Signals RST Input Global synchronous set reset Input Memory clock CLK HW_TRIGG Input INTERRUPT Auxiliary Signals Hardware trigger signal for start of processing edge sensitive active high Interrupt signal level sensitive active high VIDEO_IN_CURR_VBUFF Video input double triple buffering Current video memory buffer VIDEO_IN_NEXT_VBUFF Video input double triple buffering Next video memory buffer to write to VIDEO_IN_SW_VBUFF VIDEO_IN_SW_GRANT Video input double triple buffering Request for buffer switching Video input double triple buffering Buffer switching granted VIDEO_IN_ODD_FIELD Video input odd field for de interlacing VIDEO_OUT_CURR_VBUFF Video output double triple buffering Current video memory buffer VIDEO_OUT_NEXT_VBUFF VIDEO_OUT_SW_VBUFF Video output double triple buffering Next video memory buffer to write to Video output double triple buffering Request for buffer switching VIDEO_OUT_SW_GRANT Video output double triple buffering Buffer switching granted Copyright Xylon d o o
15. eC PSS SS ee ee ee Perspective Transformation Perspective Transformation Perspective Transformation Exmpl 1 Exmpl 2 Exmpl 3 Figure 2 logiVIEW Processing Flow with Lens Correction and Homographic Transformation Examples The logiVIEW can be used in automotive Driver Assistance DA applications such as the Four Camera System for Surround View DA Figure 4 5 and 6 Heads Up Displays HUD Lane Departure Warning Rear View Back Up and others Due to its high versatility and configurability it can be also used in other single or multi camera applications such as medical endoscopy surveillance systems Panoramic 360 View camera Figure 7 defense equipment etc The image compensation for fish eye distortions inserted by wide angle FOV lenses rectilinearly projects the camera captured images on the flat 2D surface suited for the LCD display Perspective transformations calculated by a programmable homographic transformation matrix enable scaling rotation cropping translation as well as simultaneous combinations of all of these transformations The Figure 2 shows several example outputs Additionally the logiVIEW IP core can be configured to use an optional Memory Look Up Table MLUT block at each video output The MLUT can be programmed with an arbitrary transformation function to execute different transformations on input video picture s parts for example gradual compensation of fisheye lens distortions at picture s edges
16. emonstrates video frame grabbing frame rate conversion and display overlay with graphics touch screen HMI controls To learn more about and to download the logiIREF VROT FMC reference design visit the web Email support logicbricks com URL http www logicbricks com logicBRICKS Reference logicBRICKS Design Low Latency Video Rotation for Xilinx SoC FPGA aspx The logiADAK is a great programmable platform for upcoming automotive driver assistance applications that require intensive real time video processing parallel execution of multiple advanced algorithms and versatile interfacing with sensors and vehicle s communication backbones The abundant performance and reprogrammability of the Zynq 7000 device enables ADAS designers to design SoCs that outperform competing solutions and achieve a new level of system differentiation through a combination of hardware accelerated video inputs from multiple camera inputs and the ability to quickly adapt to ever changing sensor setups and interfacing To learn more about the logiADAK Automotive Driver Assistance Kit contact Xylon or visit the web Email support logicbricks com URL www logicbricks com Products logiADAK aspx Copyright Xylon d o o 2001 2015 All Rights Reserved Page 9 of 10 logiVIEW Image Processor Data Sheet Version v3 11 Ordering Information This product is available directly from Xylon under the terms of the Xylon s IP License Please contact Xylon for pricing and a
17. r various advanced defense systems are application examples that require real time video rotation for an arbitrary angle which can be dynamically changed in sub degree steps and very small video output latency To learn more about the video rotation by the logiVIEW IP core and to see Xylon demo in operation please visit http www logicbricks com logicBRICKS Reference logicBRICKS Design Low Latency Video Rotation for Xilinx SoC FPGA aspx Copyright Xylon d o o 2001 2015 All Rights Reserved Page 6 of 10 logiVIEW Image Processor Data Sheet Version v3 11 Functional Description The Figure 1 presents the logiVIEW block diagram The main logiVIEW functional blocks are Perspective Transformation Lens Transformation Texture Cache and logiVIEW Control Perspective Transformation The Perspective Transformation calculates the desired perspective transformation defined by the programmable homographic matrix Output coordinates from the Perspective Transformation can be supplied either to the Lens Transformation block or directly to the Texture Cache block if the Lens Transformation is not required Lens Transformation The Lens Transformation can be used with the Perspective Transformation or without it The generated output pixel coordinates match the calibrated lens parameters Scaler The Scaler module calculates texture coordinates for input image scaling Vertical and horizontal scaling factors can be programmed independently
Download Pdf Manuals
Related Search