YYT Docs

This page is read only. You can view the source, but not change it. Ask your administrator if you think this is wrong.
====== Dual MAX9296-GMSL2 Camera Interface Expansion Board ======

===== Main Features =====

  * Compatible with TI-TDA series boards (tested with the following boards: tda4vm evaluation kit (EVM), tda4vm-starter-kit (SK)).
  * Supports up to 4 camera channels (MAX9296, 2 channels * 2).
  * Uses GPIO for power control, allowing individual power supply control for each camera channel.
  * Provides reserved multi-camera synchronization trigger interface, capable of synchronizing up to 4 cameras.
  * Offers reference drivers for some cameras.

===== Shipping List =====

  * Expansion board, quantity 1
  * Screws, several (SK version: diameter 2.5mm, length 5mm; EVM version: diameter 2.5mm, length 11mm)

===== Main Features  =====

  * Works with TI-TDA series boards(Test on：tda4vm evaluation kit(EVM)， tda4vm-starter-kit(SK))；
  * Connect max. 4 GMSL cameras（MAX9296， 2-channel*2）
  * Use GPIOs of serializer to control POC.
  * Reserved Fsync input port, can sync 4-camera input
  * Provide GMSL RTOS driver.

===== Shipping list =====
  * Expansion board
  * Mounting screws， (SK-board：M2.5,L=5mm; EVM：M2.5mm,L=11cm)
===== Board Diagram =====
{{ :扩展卡:dual_max9296_struct.png?400 |expansion board}}
(may change without prior notice)

==== Key Parameters ====
  * GMSL channel number: 4 (max)
  * Power Supply: 5-20V， USB-c, 45W USB-PD compliant 
  * GMSL POC voltage 8.8 - 9V， 800mA for each link
  * Support internel/external sync
  * GMSL Link status indication



===== Installation and Connection =====

**Attention: please use components we provided to install and fasten the expansion board, or may affect system stability.**

==== SK board installation ====
As shown in image below, expansion board and mainboard are connected use three M2.5/L=5mm spacer.

{{ :扩展卡:dual9296_sk_stack_v5.png?direct&600 |}}

{{ :扩展卡:dual9296_sk_stack_v5_1.png?direct&600 |}}

==== EVM Installation ====
Expansion board and EVM board are connect with 3 M2.5/L=11mm spacer。

{{ :扩展卡:dual9296_evm_stack_v4-3.png?direct&600 |}}

{{ :扩展卡:dual9296_evm_stack_v4-4.png?direct&600 |}}

==== Connect Power Supply ====
Please use offical recommend power supply and ensure sufficient capacity.


==== Connect GMSL Camera ====
  * Confirm that the POC voltage matches camera norminal working voltage.
  * If POC control is not necessary, please install 'force-power-on' jumpper.

> No GMSL camera? check out our [[en:摄像头及视频源:gmsl2摄像头|GMSL cameras]] or video inject devices: [[en:摄像头及视频源:hdmi转gmsl|yCamSim-basic]], [[en:摄像头及视频源:hdmi转gmsl_支持raw输出|yCamSim-pro]], [[en:摄像头及视频源:video_injection_trueraw|yCamSim-ultra]]


===== Quick Start =====

#: Step 1: Connect hardware
Please connect main board and expansion board according to description above. Please ensure reliable connection or cause improper operation or even damage to the hardware.
{{ :扩展卡:微信图片_20230226222957.jpg?direct&600 |}}

:#

#: Step 2: Connect Camera(s)
With provides firmware, we add support of two GMSL cameras:
  * GW5200-IMX390-GMSL2 from sensing world. 
  * HDMI to GMSL2 video convertor:[[en:摄像头及视频源:hdmi转gmsl|yCamSim-basic]]

{{ :扩展卡:微信图片_20230226222909.jpg?direct&600 |}}

For other cameras, please checkout our guide of porting drivers.
**Please pay attention to camera supply voltage**

:#

#: Step 3: Main board setup
Insert TF card we provide. currently, we provide Images of SK board only. Compare with officail Image, we made following changes:
  * Display controlled by R5, instead of Linux;
  * Camera driver/config by RTOS, instead of linux.
  * NNET use openvx framework.

Connect display, ethernet cable, UART cable. Please use HDMI display.


:#

#: Step 4: Power on
Connect power supply to Type-C port of main board, ensure that the LED status is normal, and confirm:
  * Type-C USB has sufficient capability.
  * Camera POC jumpper is installed. (if it is control by GPIO, jumps are not necessary)

:#

#: Step 5: Run test application
Use SSH/UART to login to a terminal, run below script to setup environment:

<hidden>
<code bash>
cd /opt/vision_apps
source ./vision_apps_init.sh
./run_app_single_cam.sh
</code>
</hidden>

**注意，注意，如果摄像头连接的是CH1，需要运行针对CSIRX2_1编译的程序。**
<code bash>
./run_app_single_cam_ch1.sh
</code>

正常运行时的log [采购后可查看]
<nodisp>
<code bash>
root@j7-evm:/opt/vision_apps# ./run_app_single_cam.sh
APP: Init ... !!!
MEM: Init ... !!!
MEM: Initialized DMA HEAP (fd=4) !!!
MEM: Init ... Done !!!
IPC: Init ... !!!
IPC: Init ... Done !!!
REMOTE_SERVICE: Init ... !!!
REMOTE_SERVICE: Init ... Done !!!
   535.601103 s: GTC Frequency = 200 MHz
APP: Init ... Done !!!
   535.601221 s:  VX_ZONE_INIT:Enabled
   535.601231 s:  VX_ZONE_ERROR:Enabled
   535.601243 s:  VX_ZONE_WARNING:Enabled
   535.601917 s:  VX_ZONE_INIT:[tivxInitLocal:130] Initialization Done !!!
   535.602127 s:  VX_ZONE_INIT:[tivxHostInitLocal:86] Initialization Done for HOST !!!
sensor_selection = [0]
ldc_enable = [0]
num_frames_to_run = [1000000000]
is_interactive = [1]
IttCtrl_registerHandler: command echo registered at location 0 
IttCtrl_registerHandler: command iss_read_2a_params registered at location 1 
IttCtrl_registerHandler: command iss_write_2a_params registered at location 2 
IttCtrl_registerHandler: command iss_raw_save registered at location 3 
IttCtrl_registerHandler: command iss_yuv_save registered at location 4 
IttCtrl_registerHandler: command iss_read_sensor_reg registered at location 5 
IttCtrl_registerHandler: command iss_write_sensor_reg registered at location 6 
IttCtrl_registerHandler: command dev_ctrl registered at location 7 
IttCtrl_registerHandler: command iss_send_dcc_file registered at location 8 
 NETWORK: Opened at IP Addr = 192.168.123.158, socket port=5000!!!
   535.606638 s: ISS: Enumerating sensors ... !!!
   535.607496 s: ISS: Enumerating sensors ... found 0 : ON_AR0231_9296_96705_1K_CH0
   535.607506 s: ISS: Enumerating sensors ... found 1 : S_IMX390_9296_9295_2K_CH1
   535.607514 s: ISS: Enumerating sensors ... found 2 : S_OX01_9296_96705_1K_S_CH1
   535.607521 s: ISS: Enumerating sensors ... found 3 : S_OX08_9296_9295_4K_CH0
   535.607527 s: ISS: Enumerating sensors ... found 4 : XREAL_0231_9296_9295_2K_CH0
   535.607533 s: ISS: Enumerating sensors ... found 5 : XREAL_LT6911_HDMI_4K
   535.607539 s: ISS: Enumerating sensors ... found 6 : XREAL_LT6911_HDMI_3K
   535.607546 s: ISS: Enumerating sensors ... found 7 : XREAL_LT6911_9296_9295_4K_CH0
   535.607552 s: ISS: Enumerating sensors ... found 8 : XREAL_LT6911_9296_9295_2K_CH0
Select camera port index 0-7 : [MCU2_0]    535.606849 s: ImageSensor_RemoteServiceHandler: IM_SENSOR_CMD_CREATE 
[MCU2_0]    535.606969 s: set I2C mux to config serdes and camera.
0
9 registered sensor drivers
a : ON_AR0231_9296_96705_1K_CH0 
b : S_IMX390_9296_9295_2K_CH1 
c : S_OX01_9296_96705_1K_S_CH1 
d : S_OX08_9296_9295_4K_CH0 
e : XREAL_0231_9296_9295_2K_CH0 
f : XREAL_LT6911_HDMI_4K 
g : XREAL_LT6911_HDMI_3K 
h : XREAL_LT6911_9296_9295_4K_CH0 
i : XREAL_LT6911_9296_9295_2K_CH0 
Select a sensor above or press '0' to autodetect the sensor : Invalid selection 
. Try again 
9 registered sensor drivers
a : ON_AR0231_9296_96705_1K_CH0 
b : S_IMX390_9296_9295_2K_CH1 
c : S_OX01_9296_96705_1K_S_CH1 
d : S_OX08_9296_9295_4K_CH0 
e : XREAL_0231_9296_9295_2K_CH0 
f : XREAL_LT6911_HDMI_4K 
g : XREAL_LT6911_HDMI_3K 
h : XREAL_LT6911_9296_9295_4K_CH0 
i : XREAL_LT6911_9296_9295_2K_CH0 
Select a sensor above or press '0' to autodetect the sensor : c
Sensor selected : S_OX01_9296_96705_1K_S_CH1
LDC Selection Yes(1)/No(0) : LDC Selection Yes(1)/No(0) : 0
Querying S_OX01_9296_96705_1K_S_CH1 
   540.507882 s: ISS: Querying sensor [S_OX01_9296_96705_1K_S_CH1] ... !!!
   540.508334 s: ISS: Querying sensor [S_OX01_9296_96705_1K_S_CH1] ... Done !!!
YUV Input selected. VISS and AEWB nodes will be bypassed. 
   540.508352 s: ISS: Initializing sensor [S_OX01_9296_96705_1K_S_CH1], doing IM_SENSOR_CMD_PWRON ... !!!
   540.508796 s: ISS: Initializing sensor [S_OX01_9296_96705_1K_S_CH1], doing IM_SENSOR_CMD_CONFIG ... !!!
[MCU2_0]    540.508085 s: ImageSensor_RemoteServiceHandler: IM_SENSOR_CMD_QUERY 
[MCU2_0]    540.508146 s: Received Query for S_OX01_9296_96705_1K_S_CH1 
[MCU2_0]    540.508540 s: ImageSensor_RemoteServiceHandler: IM_SENSOR_CMD_PWRON 
[MCU2_0]    540.508592 s: IM_SENSOR_CMD_PWRON : channel_mask = 0x1 
[MCU2_0]    540.508637 s: OV10640s_PowerOn : chMask = 0x0 
[MCU2_0]    540.508969 s: ImageSensor_RemoteServiceHandler: IM_SENSOR_CMD_CONFIG 
[MCU2_0]    540.509020 s: Application requested features = 0x0 
[MCU2_0]  
[MCU2_0]    540.509061 s: Configuring camera # 0 
[MCU2_0]    540.509096 s: 
[MCU2_0] reset max9296
[MCU2_0]    540.608392 s: 
[MCU2_0] power off all cameras.
[MCU2_0]    540.608438 s: 
[MCU2_0] Turn on surround view cameras, channel 0.
[MCU2_0]    541.108387 s: 
[MCU2_0]  turn off output serializer. 
[MCU2_0]    541.108432 s: Config de-serial.
[MCU2_0]    541.108465 s: i2c write: Ins:3, dev:0x48, reg:0x313, val:0x0
[MCU2_0]    541.113392 s: 
[MCU2_0]    541.113424 s: config serializer. 
[MCU2_0]    541.113455 s: i2c write: Ins:3, dev:0x40, reg:0x4d, val:0xc0
[MCU2_0]    541.163879 s: Reg: 0x4d: val: 0xc0
[MCU2_0]    541.164876 s: Reg: 0x 0: val: 0x80
[MCU2_0]    541.165877 s: Reg: 0x 1: val: 0x90
[MCU2_0]    541.166391 s: i2c write: Ins:3, dev:0x40, reg:0x4, val:0x43
[MCU2_0]    541.216389 s: i2c write: Ins:3, dev:0x40, reg:0x6, val:0xab
[MCU2_0]    541.266390 s: i2c write: Ins:3, dev:0x40, reg:0x34, val:0xae
[MCU2_0]    541.316389 s: i2c write: Ins:3, dev:0x40, reg:0xc, val:0x80
[MCU2_0]    541.366390 s: i2c write: Ins:3, dev:0x40, reg:0x1, val:0x94
[MCU2_0]    541.416389 s: i2c write: Ins:3, dev:0x40, reg:0xb, val:0x8a
[MCU2_0]    541.466390 s: i2c write: Ins:3, dev:0x40, reg:0x7, val:0x84
[MCU2_0]    541.516390 s: i2c write: Ins:3, dev:0x40, reg:0xf, val:0xbf
[MCU2_0]    541.566388 s: i2c write: Ins:3, dev:0x40, reg:0x67, val:0xc4
[MCU2_0]    541.616389 s: i2c write: Ins:3, dev:0x40, reg:0x43, val:0x25
[MCU2_0]    541.666390 s: i2c write: Ins:3, dev:0x40, reg:0x48, val:0x2d
[MCU2_0]    541.716388 s: i2c write: Ins:3, dev:0x40, reg:0x49, val:0x98
[MCU2_0]    541.766389 s: i2c write: Ins:3, dev:0x40, reg:0x4, val:0x83
[MCU2_0]    542.049338 s: set I2C mux to config serdes and camera.
[MCU2_0]    542.050296 s: Reg: 0x 4: val: 0x83
[MCU2_0]    542.050927 s: Reg: 0x48: val: 0x2d
[MCU2_0]    542.051920 s: Reg: 0x49: val: 0x98
[MCU2_0]    542.252391 s: Config de-serial.
[MCU2_0]    542.252433 s: i2c write: Ins:3, dev:0x48, reg:0xb06, val:0x87
[MCU2_0]    542.257388 s: i2c write: Ins:3, dev:0x48, reg:0xc06, val:0x87
[MCU2_0]    542.295387 s: i2c write: Ins:3, dev:0x48, reg:0xb07, val:0x84
[MCU2_0]    542.300388 s: i2c write: Ins:3, dev:0x48, reg:0xc07, val:0x84
[MCU2_0]    542.305386 s: i2c write: Ins:3, dev:0x48, reg:0x11, val:0xf
[MCU2_0]    542.310387 s: i2c write: Ins:3, dev:0x48, reg:0x6, val:0x1f
[MCU2_0]    542.315388 s: i2c write: Ins:3, dev:0x48, reg:0xb0d, val:0x80
[MCU2_0]    542.320388 s: i2c write: Ins:3, dev:0x48, reg:0xc0d, val:0x80
[MCU2_0]    542.325386 s: i2c write: Ins:3, dev:0x48, reg:0x322, val:0x30
[MCU2_0]    542.330388 s: i2c write: Ins:3, dev:0x48, reg:0xf00, val:0x1
[MCU2_0]    542.335389 s: i2c write: Ins:3, dev:0x48, reg:0x40b, val:0x7
[MCU2_0]    542.340386 s: i2c write: Ins:3, dev:0x48, reg:0x42d, val:0x15
[MCU2_0]    542.345387 s: i2c write: Ins:3, dev:0x48, reg:0x40d, val:0x1e
[MCU2_0]    542.350387 s: i2c write: Ins:3, dev:0x48, reg:0x40e, val:0x1e
[MCU2_0]    542.355387 s: i2c write: Ins:3, dev:0x48, reg:0x40f, val:0x0
[MCU2_0]    542.360385 s: i2c write: Ins:3, dev:0x48, reg:0x410, val:0x0
[MCU2_0]    542.365388 s: i2c write: Ins:3, dev:0x48, reg:0x411, val:0x1
[MCU2_0]    542.370387 s: i2c write: Ins:3, dev:0x48, reg:0x412, val:0x1
[MCU2_0]    542.375387 s: i2c write: Ins:3, dev:0x48, reg:0x330, val:0x4
[MCU2_0]    542.380387 s: i2c write: Ins:3, dev:0x48, reg:0x44a, val:0xd0
[MCU2_0]    542.385387 s: i2c write: Ins:3, dev:0x48, reg:0x320, val:0x24
[MCU2_0]    542.390387 s: i2c write: Ins:3, dev:0x48, reg:0x325, val:0x80
[MCU2_0]    542.395386 s: i2c write: Ins:3, dev:0x48, reg:0x319, val:0x8
[MCU2_0]    542.400388 s: i2c write: Ins:3, dev:0x48, reg:0x316, val:0x5e
[MCU2_0]    542.405387 s: i2c write: Ins:3, dev:0x48, reg:0x317, val:0xe
[MCU2_0]    542.410386 s: i2c write: Ins:3, dev:0x48, reg:0x31d, val:0xc0
[MCU2_0]    542.415388 s: i2c write: Ins:3, dev:0x48, reg:0x1da, val:0x18
[MCU2_0]    542.420388 s: i2c write: Ins:3, dev:0x48, reg:0x1fa, val:0x18
[MCU2_0]    542.425387 s: i2c write: Ins:3, dev:0x48, reg:0xb0f, val:0x8
[MCU2_0]    542.430387 s: i2c write: Ins:3, dev:0x48, reg:0xc0f, val:0x8
   542.635601 s: ISS: Initializing sensor [S_OX01_9296_96705_1K_S_CH1] ... Done !!!
[MCU2_0]    542.635387 s: IM_SENSOR_CMD_CONFIG returning status = 0 
Scaler is disabled
   542.643076 s: ISS: Starting sensor [S_OX01_9296_96705_1K_S_CH1] ... !!!


 ==========================
 Demo : Single Camera w/ 2A
 ==========================

 p: Print performance statistics

 s: Save Sensor RAW, VISS Output and H3A output images to File System

 e: Export performance statistics

 u: Update DCC from File System


 x: Exit

 Enter Choice: 
Unsupported command 



 ==========================
 Demo : Single Camera w/ 2A
 ==========================

 p: Print performance statistics

 s: Save Sensor RAW, VISS Output and H3A output images to File System

 e: Export performance statistics

 u: Update DCC from File System


 x: Exit

 Enter Choice: [MCU2_0]    542.643377 s: ImageSensor_RemoteServiceHandler: IM_SENSOR_CMD_STREAM_ON 
[MCU2_0]    542.643464 s: IM_SENSOR_CMD_STREAM_ON:  channel_mask = 0x1
[MCU2_0]    542.643514 s: start streaming
[MCU2_0]    542.643543 s: i2c write: Ins:3, dev:0x48, reg:0x313, val:0x42
[MCU2_0]    542.844203 s: Reg: 0x313: val: 0x42
[MCU2_0]    542.894188 s: Reg: 0x1dc: val: 0x 0
[MCU2_0]    542.944185 s: Reg: 0x1fc: val: 0x 1
[MCU2_0]    542.994182 s: Reg: 0x21c: val: 0x 0
[MCU2_0]    543.044186 s: Reg: 0x23c: val: 0x 0
[MCU2_0]    543.094181 s: Reg: 0x3e0: val: 0x e
[MCU2_0]    543.194182 s: Reg: 0x127: val: 0x40
   543.293582 s: ISS: Starting sensor [S_OX01_9296_96705_1K_S_CH1] ... !!!
</code>
</nodisp>

:#

===== 其它注意事项 =====
==== 软件开发环境建立 ====
=== 使用EVM板 ===

可以直接使用，具体使用方法，请参考官方文档。

=== 使用SK板 ===

需要对SDK进行一些修改，请参考文档 [[tda4系列:利用starter-kit开发板开发rtos应用]]

==== 解串的地址 ====
MAX9296的默认地址
  ** CH0: 0x48
  ** CH1: 0x4a

==== 默认工作模式及修改 ====
=== 默认工作模式 ===

CH0, CH1的MAX9296的默认工作模式均为：GMSL2, 6Gbps.

=== 通过硬件跳线修改默认工作模式 ===
Max9296 支持GMSL1/GMSL2, 3G/6G， coax/stp， i2c/uart 等在上电时通过分压电阻进行配置。这些配置不建议修改，但如需修改，推荐使用I2C修改寄存器的方式修改。如果确需要修改硬件，参考下图：
{{ :扩展卡:whiteboard_exported_image_3_.png?direct&600 |}}

电阻的选择请参考 美信 数据手册。

=== 通过软件I2C配置工作模式 ===

使用I2C修改GMSL模式，参考如下代码，可以在不变更硬件的情况下，在GMSL1/GMSL2模式下切换。
具体操作，请参考：[[GMSL相关文章:软件修改MAX9296的模式及速率]] 。


==== 配置帧同步信号 ====
使用多个摄像头需要进行同步。当MAX9296工作于GMSL1，或GMSL2模式时，其同步配置是不同的。
具体的操作及配置，请参考：[[GMSL相关文章:MAX9296的多相机FSYNC配置]].