Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor 1/6-Inch 720p High-Definition (HD) System-On-AChip (SOC) Digital Image Sensor MT9M114 Data Sheet For the latest data sheet, refer to Aptina's Web site: www.aptina.com Features * * * * * * * * * * * * * * * * Table 1: Superior low-light performance Ultra-low-power 720p HD video at 30 fps Internal master clock generated by on-chip phase-locked loop (PLL) oscillator Electronic rolling shutter (ERS), progressive scan Integrated image flow processor (IFP) for single-die camera module Automatic image correction and enhancement Arbitrary image scaling with anti-aliasing Two-wire serial interface providing access to registers and microcontroller memory Selectable output data format: YCbCr, 565RGB, 555RGB, 444RGB, processed Bayer, BT656, RAW8- and RAW8+2-bit Parallel and MIPI data output Independently configurable gamma correction Adaptive Polynomial lens shading correction UVC interface Perspective correction Multi-camera synchronization Parameter Typical Value Optical format Active pixels Pixel size Color filter array Shutter type Input clock range Output pixel clock maximum Output MIPI data rate maximum Max. Frame Rate 1/6-inch 1296 x 976= 1.26 Mp 1.9 m x 1.9 m RGB Bayer Electronic rolling shutter (ERS) 6 - 54 MHz 96 MHz 768 Mb/s 30 fps full res 36.7 fps 720p 75 fps VGA 120 fps QVGA2 2.24 V/lux-sec(550 nm) 37 dB 70.8 dB 1.7 - 1.95V 2.5 - 3.1V 1.7 - 1.95V or 2.5 - 3.1V 2.5 - 3.1V 1.7 - 1.95V 135 mW -30C to +70 C Responsivity SNRMAX Dynamic range Supply voltage Digital Analog I/O PLL PHY Power consumption1 Operating temperature (ambient) -TA Chief ray angle Active imager size Applications * Embedded notebook, netbook, and desktop monitor cameras * Tethered PC cameras * Game consoles * Cell phones, mobile devices, and consumer video communications * Surveillance, medical, and industrial applications Package options Notes: General Description 27.7 2.46mm (H) x 1.85mm (V), 3.08mm diagonal Bare die, CSP 1. Power consumption for typical voltages and 720p output. 2. Reduced FOV Ordering Information Aptina 's MT9M114 is a 1/6-inch 1.26 Mp CMOS digital image sensor with an active-pixel array of 1296H x 976V. It includes sophisticated camera functions such as auto exposure control, auto white balance, black level control, flicker avoidance, and defect correction. It is designed for low light performance.The MT9M114 produces extraordinarily clear, sharp digital pictures, making it the perfect choice for a wide range of applications, including mobile phones, PC and notebook cameras, and gaming systems. PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN Key Parameters Table 2: Available Part Numbers Part Number MT9M114D00STCZ K24BC1 MT9M114EBLSTCZ MT9M114D00STCZH ES MT9M114D00STCZD ES 1 . Description RGB color die 55-pin CSP RGB color demo headboard RGB color demo kit . (c)2009 Aptina Imaging Corporation All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Table of Contents Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1 Applications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1 General Description . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1 Ordering Information . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1 Functional Description . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .6 Architecture Overview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .6 Sensor Core. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .7 Image Flow Processor (IFP). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .7 Microcontroller Unit (MCU) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .7 System Control. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .7 Output Interface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .7 System Interfaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .7 Decoupling Capacitor Recommendations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .10 Output Data Format . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .10 Power-Up and Power-Down Sequence . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .11 Reset . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .12 Hard Reset . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .12 Soft Reset . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .14 Soft Standby Mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .14 Entering Standby Mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .14 Exiting Standby Mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .15 Image Data Output Interface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .16 Parallel Port . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .16 Serial Port . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .17 Sensor Control . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .18 Pixel Readouts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .22 Binning and Summing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .25 Image Flow Processor. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 Digital Gain . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .28 Adaptive PGA (APGA) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .28 Color Interpolation and Edge Detection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .28 Color Correction and Aperture Correction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .28 Gamma Correction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .29 Gamma Knee Point Calculation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .30 Gamma Curve Selection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .32 Fade to Black Selection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .33 Image Scaling and Cropping. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .34 Hue Rotate . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .34 Vertical Perspective Correction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .34 Camera Control and Auto Functions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .37 Auto Exposure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .37 AE Track Driver . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .39 Auto White Balance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .40 Flicker Avoidance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .40 Output Conversion and Formatting. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .41 Color Conversion Formulas . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .41 Uncompressed YUV/RGB Data Ordering . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .42 Uncompressed Raw Bayer Bypass Output. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .42 UVC Interface. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .43 Multi-Camera Sync . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .44 Configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .45 PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN 2 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Theory Of Operation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .46 Using Multi-Sync . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .46 Clocking . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .46 Hardware Functions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .47 Two-Wire Serial Interface. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .47 Protocol . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .47 Slave Address . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .47 Message Byte . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .48 Acknowledge Bit . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .48 No-Acknowledge Bit . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .48 Stop Condition . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .48 Typical Serial Transfer. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .48 Single Read from Random Location. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .49 Single Read from Current Location . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .49 Sequential Read, Start from Random Location . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .50 Sequential Read, Start from Current Location. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .50 Single Write to Random Location . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .50 Sequential Write, Start at Random Location . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .51 Patch RAM . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .51 Chief Ray Angle . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .52 Electrical Specifications. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .54 Recommended Operating Conditions. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .55 MIPI AC and DC Electrical Characteristics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .60 Package Dimensions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .62 Revision History. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .64 PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN 3 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor List of Figures Figure 1: Figure 2: Figure 3: Figure 4: Figure 5: Figure 6: Figure 7: Figure 8: Figure 9: Figure 10: Figure 11: Figure 12: Figure 13: Figure 14: Figure 15: Figure 16: Figure 17: Figure 18: Figure 19: Figure 20: Figure 21: Figure 22: Figure 23: Figure 24: Figure 25: Figure 26: Figure 27: Figure 28: Figure 29: Figure 30: Figure 31: Figure 32: Figure 33: Figure 34: Figure 35: Figure 36: Figure 37: Figure 38: MT9M114 Block Diagram . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .6 Typical Configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .8 Spatial Illustration of Image Readout. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .10 Power-Up and Power-Down Sequence . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .11 Hard Reset Operation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .13 Soft Reset Operation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .14 Pixel Data Timing Example. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .16 Row Timing, FV, and LV Signals . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .16 Sensor Core Block Diagram . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .18 Pixel Color Pattern Detail (Bottom Left Corner) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .19 Imaging a Scene . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .20 Three Pixels in Normal and Column Mirror Readout Mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .20 Three Rows in Normal and Row Mirror Readout Mode. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .21 Eight Pixels in Normal and Column Skip 2X Readout Mode. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .21 Pixel Readout (No Skipping). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .22 Pixel Readout (Column Skipping) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .23 Pixel Readout (Row Skipping) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .23 Pixel Readout (Column and Row Skipping) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .24 Pixel Binning and Summing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .25 Pixel Readout (Column and Row Binning) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .25 Image Flow Processor . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 Color Bar Test Pattern . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .27 Gamma Interaction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .30 Automatic Gamma Curve . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .31 Gamma Reference Variables Against Brightness Metric . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .32 5 x 5 Grid . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .37 Multi-Camera Connection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .44 Normal Use of SADDR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .45 Single Read from Random Location . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .49 Single Read from Current Location . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .49 Sequential Read, Start from Random Location . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .50 Sequential Read, Start from Current Location . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .50 Single Write to Random Location . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .50 Sequential Write, Start at Random Location . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .51 Typical Quantum Efficiency . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .53 Parallel Pixel Bus Timing Diagram . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .58 Two-Wire Serial Bus Timing Parameters. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .59 Package Mechanical Drawing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .63 PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN 4 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor List of Tables Table 1: Table 2: Table 3: Table 4: Table 5: Table 6: Table 7: Table 8: Table 9: Table 10: Table 11: Table 12: Table 13: Table 14: Table 15: Table 16: Table 17: Table 18: Table 19: Table 20: Table 21: Table 22: Table 23: Table 24: Table 25: Table 26: Table 27: Table 28: Table 29: Table 30: Table 31: Table 32: Key Parameters . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1 Available Part Numbers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1 Pin Descriptions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .9 Power-Up and Power-Down Signal Timing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .11 Status of Output Signals During Hard Reset, Soft Standby, and Power Off . . . . . . . . . . . . . . . . . . . . . .12 Hard Reset . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .13 Soft Reset Signal Timing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .14 Variables Required for Gamma Knee Point Calculation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .30 Gamma curve Selection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .32 Fade-to-Black Selection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .33 Hue Control . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .34 YCbCr Output Data Ordering. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .42 RGB Ordering in Default Mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .42 2-Byte Bayer Format . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .42 Summary of UVC Commands . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .43 CHAIN_CONTROL Register . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .45 Chief Ray Angle . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .52 Absolute Maximum Ratings . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .54 Operating Conditions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .55 DC Electrical Characteristics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .55 Operating Current Consumption . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .56 Standby Current Consumption (Parallel and MIPI) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .57 AC Electrical Characteristics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .58 Two-Wire Serial Interface Timing Data . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .59 MIPI High-Speed Transmitter DC Specifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .60 MIPI High-Speed Transmitter AC Specifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .60 MIPI Low-Power Transmitter DC Characteristics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .60 MIPI Low-Power Transmitter AC Characteristics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .60 Clock Signal Specification. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .60 Data-Clock Timing Specifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .61 Package Dimensions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .62 Ball Matrix . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .63 PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN 5 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Functional Description Aptina's MT9M114 is a 1/6-inch 1.26 Mp CMOS digital image sensor with an integrated advanced camera system. This camera system features a microcontroller (MCU), a sophisticated image flow processor (IFP), MIPI and parallel output ports (only one output port can be used at a time). The microcontroller manages all functions of the camera system and sets key operation parameters for the sensor core to optimize the quality of raw image data entering the IFP. The IFP will be responsible for processing and enhancing the image. The entire system-on-a-chip (SOC) has superior low-light performance that is particularly suitable for PC camera applications. The MT9M114 features Aptina's breakthrough low-noise CMOS imaging technology that achieves near-CCD image quality (based on signal-to-noise ratio and low-light sensitivity) while maintaining the inherent size, cost, and integration advantages of CMOS. The Aptina(R) MT9M114 can be operated in its default mode or programmed for frame size, exposure, gain, and other parameters. The default mode output is a 720p image size at 30 frames per second (fps), assuming a 24MHz input clock. It outputs 8-bit data, using the parallel output port. Architecture Overview The MT9M114 combines a 1.26 Mp sensor core with an IFP to form a stand-alone solution for both image acquisition and processing. Both the sensor core and the IFP have internal registers that can be controlled by the user. In normal operation, an integrated microcontroller autonomously controls most aspects of operation. The processed image data is transmitted to the host system either through the parallel or MIPI interface. Figure 1 shows the major functional blocks of the MT9M114. MT9M114 Block Diagram Sensor C ore Im age F low Processor (IF P ) Output Interface Formatter Figure 1: Pixel Array F IF O C olor Pipeline MIPI Parallel Stats Engine Internal R egister Bus POR R OM M icrocontroller SR AM T w o- W ire Serial IF System C ontrol PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN M icrocontroller U nit (MCU) 6 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Sensor Core The MT9M114 has a color image sensor with a Bayer color filter arrangement and a 1.2Mp active-pixel array with electronic rolling shutter (ERS). The sensor core readout is 10 bits and can be flipped and/or mirrored. The sensor core also supports separate analog and digital gain for all four color channels (R, Gr, Gb, B). Image Flow Processor (IFP) The advanced IFP features and flexible programmability of the MT9M114 can enhance and optimize the image sensor performance. Built-in optimization algorithms enable the MT9M114 to operate with factory settings as a fully automatic and highly adaptable system-on-a-chip (SOC) for most camera systems. These algorithms include black level conditioning, shading correction, defect correction, color interpolation, edge detection, color correction, vertical perspective correction, aperture correction, and image formatting with cropping and scaling. Microcontroller Unit (MCU) The MCU communicates with all functional blocks by way of an internal Aptina proprietary bus interface. The MCU firmware configures all the registers in the sensor core and IFP. System Control The MT9M114 has a phase-locked loop (PLL) oscillator that can generate the internal sensor clock from a common wireless system clock. The PLL adjusts the incoming clock frequency up, allowing the MT9M114 to run at almost any desired resolution and frame rate within the sensor's capabilities. Low-power consumption is a very important requirement. The MT9M114 provides power-conserving features including a soft standby mode. A two-wire serial interface bus enables read and write access to the MT9M114's internal registers and variables. The internal registers control the sensor core, the color pipeline flow, and the output interface. Variables are located in the microcontroller's RAM memory and are used to configure and control the auto-algorithms and camera control functions. Output Interface The output interface block can select either raw data or processed data. Image data is provided to the host system either by an 8-bit parallel port or by a serial MIPI port. The parallel output port provides 8-bit RGB data or extended 10-bit Bayer data. The MT9M114 also includes programmable I/O slew rate to minimize EMI. System Interfaces Figure 2 on page 8 shows typical MT9M114 device connections. For low-noise operation, the MT9M114 requires separate power supplies for analog and digital sections of the die. Both power supply rails must be decoupled from ground using capacitors as close as possible to the die. The use of inductance filters is not recommended on the power supplies or output signals. The MT9M114 provides dedicated signals for digital core, PHY, and I/O power domains that can be at different voltages. The PLL and analog circuitry require clean power sources. Table 3 on page 9 provides the signal descriptions for the MT9M114. PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN 7 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Figure 2: Typical Configuration RPULL-UP4 I/O5 power PHY2 power Digital core PLL power power Analog power VDD_IO VDD_PHY VDD_PLL VDD VAA SADDR SDATA SCLK Two-wire serial interface DOUT[7:0] Active LOW reset RESET_BAR6 External clock in (6-54 MHz) EXTCLK Active HIGH Default settings PIXCLK LINE_VALID FRAME_VALID DATA_N DATA_P CONFIG6 CLK_N GND_PLL DGND Notes: PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN OR3 MIPI Serial Port CLK_P TRST_BAR8 OE_BAR9 VDD_IO5, 7 Parallel Port VDD_PHY2, 7 VDD_PLL7 VDD7 AGND VAA7 1. This typical configuration shows only one scenario out of multiple possible variations for this sensor. 2. If a MIPI Interface is not required, the following signals must be left floating: DATA_P, DATA_N, CLK_P, and CLK_N. The VDD_PHY power signal must always be connected to the 1.8V supply. 3. Only one of the output modes (serial or parallel) can be used at any time. 4. Aptina recommends a 1.5k resistor value for the two-wire serial interface RPULL-UP; however, greater values may be used for slower transmission speed. 5. All inputs must be configured with VDD_IO. 6. RESET_BAR and CONFIG both have internal pull-up resistors and can be left floating. 7. Aptina recommends that 0.1F and 1F decoupling capacitors for each power supply are mounted as close as possible to the pad. Actual values and numbers may vary depending on layout and design considerations. 8. TRST_BAR connects to GND for normal operation. 9. OE_BAR should be connected HIGH when using MIPI interface. 8 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Table 3: Pin Descriptions Name Type EXTCLK RESET_BAR OE_BAR SCLK SDATA SADDR FRAME_VALID (FV) Input Input/PU Input Input I/O Input Output LINE_VALID (LV) Output PIXCLK DOUT[7:0] DOUT_LSB[1:0] CLK_N CLK_P DATA_N DATA_P CONFIG Output Output Output Output Output Output Output Input/PU FLASH CHAIN TRST_BAR VDD DGND VDD_IO GND_IO VAA AGND VDD_PLL GND_PLL VDD_PHY Output Output/PU Input Supply Supply Supply Supply Supply Supply Supply Supply Supply Notes: PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN Description Notes Input clock signal. Master reset signal, active LOW. This signal has an internal pull up. Parallel interface enable pad, active LOW. Two-wire serial interface clock. Two-wire serial interface data. Selects device address for the two-wire serial interface. Identifies rows in the active image. Data can be sampled with PIXCLK when both LV and FV are high (except when BT656 is used). Identifies pixels in the active line. Data can be sampled with PIXCLK when both LV and FV are high (except when BT656 is used). Pixel clock. DOUT[7:0] for 8-bit image data output or DOUT[9:2] for 10-bit image data output. LSBs when outputting 10-bit image data Differential MIPI clock (sub-LVDS, negative). Differential MIPI clock (sub-LVDS, positive). Differential MIPI data (sub-LVDS, negative. Differential MIPI data (sub-LVDS, positive). If on power-up CONFIG = 1 then the part shall go into streaming (default option, PU ensures this will occur). If CONFIG = 0 then the part will go to standby state waiting for host to update. Used as a flash signal To synchronize a number of sensors together. Must be tied to GND in normal operation. Digital Power Digital ground. I/O power supply. I/O ground. Analog power. Analog ground. PLL Supply PLL GND I/O power supply for the MIPI interface. 2 2 2 2 4 2 2 1 1 3 1. AGND and DGND are not connected internally. 2. To be left floating if not using feature. If not using the feature, then there is no need to bond out the relevant pads. 3. Must always be connected even when not using MIPI. 4. When CONFIG = 1 the EXTCLK must be in the range 20-24 MHz. 9 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Decoupling Capacitor Recommendations It is important to provide clean, well regulated power to each power supply. The Aptina recommendation for capacitor placement and values are based on our internal demo camera design and verified in hardware. Note: Because hardware design is influenced by many factors, such as layout, operating conditions, and component selection, the customer is ultimately responsible to ensure that clean power is provided for their own designs. In order of preference, Aptina recommends: 1. Mount 0.1F and 1F decoupling capacitors for each power supply as close as possible to the pad and place a 10F capacitor nearby off-module. 2. If module limitations allow for only six decoupling capacitors for a three-regulator design use a 0.1F and 1F capacitor for each of the three regulated supplies. Aptina also recommends placing a 10F capacitor for each supply off-module, but close to each supply. 3. If module limitations allow for only three decoupling capacitors, use a 1F capacitor (preferred) or a 0.1F capacitor for each of the three regulated supplies. Aptina recommends placing a 10F capacitor for each supply off-module but close to each supply. 4. Give priority to the VAA supply for additional decoupling capacitors. 5. Inductive filtering components are not recommended. 6. Follow best practices when performing physical layout. Refer to technical note TN-09-131. Output Data Format The MT9M114 image data is read out in a progressive scan. Valid image data is surrounded by horizontal blanking and vertical blanking, as shown in Figure 3. LINE_VALID is HIGH in the shaded region of the figure. Figure 3: Spatial Illustration of Image Readout PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN 10 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Power-Up and Power-Down Sequence Powering up and poweting down the sensor requires voltages to be applied in a particular order, as seen in Figure 4. The timing requirements are shown in Table 4. The sensor includes a power-on reset feature that initiates a reset upon power up of the sensor. Figure 4: Power-Up and Power-Down Sequence VDD_IO t1 t7 VDD, VDD_PHY t2 t6 VAA, VDD_PLL t3 t5 EXTCLK S CLK t4 S DATA Table 4: Symbol t1 t2 t3 t4 t5 t6 t7 Notes: PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN Power-Up and Power-Down Signal Timing Parameter Delay from VDD_IO to VDD and VDD_PHY Delay from VDD_IO to VAA and VDD_PLL EXTCLK activation First serial command1 EXTCLK cutoff Delay from VAA and VDD_PLL to VDD_IO Delay from VDD and VDD_PHY toVDD_IO Min Typ Max Unit 0 0 t2 - t6 0 0 - - - t3 + 44 - - - 50 50 - - - 50 50 ms ms ms ms ms ms ms 1. After power-up or reset, the host should poll the Command register to determine when the device is initialized 11 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Reset The MT9M114 has 3 types of reset available: * A hard reset is issued by toggling the RESET_BAR signal * A soft reset is issued by writing commands through the two-wire serial interface * An internal power-on reset The output states during hard reset are shown in Table 5. Table 5: Status of Output Signals During Hard Reset, Soft Standby, and Power Off Signal Reset Soft Standby (EXTCLK Running) Soft Standby (Without EXTCLK ) DOUT[7:0] PIXCLK LV FV DOUT_LSB[1:0] DATA_N DATA_P CLK_N CLK_P SCLK High-Z High-Z High-Z High-Z High-Z 0 0 0 0 Input High-Z High-Z High-Z High-Z High-Z 0 0 0 0 Active SDATA Input Active High-Z High-Z High-Z High-Z High-Z 0 0 0 0 Active (Pads are active, but due to no EXTCLK serial comms will not work) Active (Pads are active, but due to no EXTCLK serial comms will not work) Power Off High-Z High-Z High-Z High-Z High-Z High-Z High-Z High-Z High-Z High-Z High-Z A soft reset sequence to the sensor has the same effect as the hard reset and can be activated by writing to a register through the two-wire serial interface. On-chip power-onreset circuitry can generate an internal reset signal in case an external reset is not provided. The RESET_BAR and CONFIG signals have internal pull-up resistors and can be left floating. Hard Reset The MT9M114 enters the reset state when the external RESET_BAR signal is asserted LOW, as shown in Figure 5. All the output signals will be in High-Z state. When OE_BAR is in HIGH state, the outputs pins will be High-Z during the internal boot time PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN 12 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Figure 5: Hard Reset Operation t4 t1 t3 t2 EXTCLK RESET_BAR SDATA All Outputs Mode Data Active controlled by OE_BAR Data Active Reset Enter streaming mode Internal Boot Time OE_BAR Table 6: Symbol t1 t2 t3 t4 Hard Reset Definition Min Typ Max RESET_BAR pulse width Active EXTCLK required after RESET_BAR asserted Active EXTCLK required before RESET_BAR de-asserted Internal boot time1 50 10 10 - - - - 44.5 - - - - Notes: PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN Unit EXTCLK cycles ms 1. Under the condition of EXTCLK=24MHz and default settings with CONFIG=1 13 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Soft Reset The host processor can reset the MT9M114 using the two-wire serial interface by writing to SYSCTL 0x001A. SYSCTL 0x001A[0] is used to reset the MT9M114 which is similar to external RESET_BAR signal. 1. Set SYSCTL 0x001A[0] to 0x1 to initiate internal reset cycle. 2. Reset SYSCTL 0x001A[0] to 0x0 for normal operation. 3. Delay of 44.5 ms. Figure 6: Soft Reset Operation t1 EXTCLK SCLK SDATA Mode Table 7: Symbol t1 Write Soft Reset Command Resetting Registers Enter Streaming Mode Soft Reset Signal Timing Parameter Soft reset time1 Notes: Min Typ Max Unit - 44.5 - ms 1. Under the condition of EXTCLK=24MHz Soft Standby Mode The MT9M114 can enter soft standby mode by receiving a host command through the two-wire serial interface. EXTCLK can be stopped to reduce the power consumption during soft standby mode. However, since two-wire serial interface requires EXTCLK to operate, Aptina recommends that EXTCLK run continuously. Entering Standby Mode 1. Send the sequence [Enter Standby] to put the MT9M114 into standby. [Enter Standby] FIELD_WR= SYSMGR_NEXT_STATE, 0x50 // (Optional) First check that the FW is ready to accept a new command ERROR_IF= COMMAND_REGISTER, HOST_COMMAND_1, !=0, "Set State cmd bit is already set" // (Mandatory) Issue the Set State command // We set the 'OK' bit so we can detect if the command fails // Note 0x8002 is equivalent to (HOST_COMMAND_OK | HOST_COMMAND_1) FIELD_WR= COMMAND_REGISTER, 0x8002 PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN 14 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor // Wait for the FW to complete the command (clear the HOST_COMMAND_1 bit) POLL_FIELD= COMMAND_REGISTER, HOST_COMMAND_1, !=0, DELAY=10, TIMEOUT=100 // Check the 'OK' bit to see if the command was successful ERROR_IF= COMMAND_REGISTER, HOST_COMMAND_OK, !=1, "Set State cmd failed", // Wait for the FW to fully-enter standby (SYSMGR_CURRENT_STATE=0x52) POLL_FIELD= SYSMGR_CURRENT_STATE,!=0x52,DELAY=50,TIMEOUT=10 2. After the part is in standby for 100 EXTCLK cycles the EXTCLK can be turned off. Exiting Standby Mode 1. Turn EXTCLK on. 2. After 100 EXTCLK cycles send the following sequence entitled [Exit Standby] to bring the MT9M114 out of standby. [Exit Standby] FIELD_WR= SYSMGR_NEXT_STATE, 0x54 // (Optional) First check that the FW is ready to accept a new command ERROR_IF= COMMAND_REGISTER, HOST_COMMAND_1, !=0, "Set State cmd bit is already set" // (Mandatory) Issue the Set State command // We set the 'OK' bit so we can detect if the command fails // Note 0x8002 is equivalent to (HOST_COMMAND_OK | HOST_COMMAND_1) FIELD_WR= COMMAND_REGISTER, 0x8002 // Wait for the FW to complete the command (clear the HOST_COMMAND_1 bit) POLL_FIELD= COMMAND_REGISTER, HOST_COMMAND_1, !=0, DELAY=10, TIMEOUT=100 // Check the 'OK' bit to see if the command was successful ERROR_IF= COMMAND_REGISTER, HOST_COMMAND_OK, !=1, "Set State cmd failed", ERROR_IF= SYSMGR_CURRENT_STATE, !=0x31, "System state is not STREAMING" PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN 15 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Image Data Output Interface The user can select either the 8-bit parallel or serial MIPI output to transmit the sensor image data to host system. Only one of the output modes can be used at any time. The MT9M114 has an output FIFO to retain a constant pixel output clock independent from the data output rate variations due to scaling factor. Parallel Port The MT9M114 image data is read out in a progressive scan mode. Valid image data is surrounded by horizontal blanking and vertical blanking. The amount of horizontal blanking and vertical blanking are programmable. MT9M114 output data is synchronized with the PIXCLK output. When LV is HIGH, one pixel value is output on the 8-bit DOUT port every TWO PIXCLK periods as shown in Figure 7. PIXCLK is continuously running, even during the blanking period. (If the user wishes to have PIXCLK turned off during blanking this is possible through a variable setting) PIXCLK phase can be varied by 50 percent, controlled using a register. Figure 7: Pixel Data Timing Example LINE_VALID PIXCLK P0 (9:2) DOUT[7:0] P0 (1:0) P1 (9:2) P1 (1:0) Blanking Figure 8: P2 (9:2) Pn-1 (9:2) Pn-1 (1:0) Pn (9:2) Valid Data Pn (1:0) Blanking Row Timing, FV, and LV Signals FRAME_VALID LINE_VALID Data Modes Notes: PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN P1 A2 Q3 A Q A P 1. P: Frame start and end blanking time. 2. A: Active data time. 3. Q: Horizontal blanking time. 16 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Serial Port This section describes how frames of pixel data are represented on the high-speed MIPIserial interface. The MIPI output transmitter implements a serial differential sub-LVDS transmitter capable of up to 768 Mb/s. It supports multiple formats, error checking, and custom short packets. MT9M114 is designed to MIPI D-PHY version v1.0. When the sensor is in the software standby system state, the MIPI signals (CLK_P, CLK_N, DATA_P, DATA_N) indicate ultra lowpower state (ULPS) corresponding to (nominal) 0V levels being driven on CLK_P, CLK_N, DATA_P, and DATA_N. This is equivalent to signaling code LP-00. When the sensor enters the streaming system state, the interface goes through the following transitions: 1. After the PLL has locked and the bias generator for the MIPI drivers has stabilized, the MIPI interface transitions from the ULPS state to the ULPS-exit state (signaling code LP-10). 2. After a delay (TWAKEUP), the MIPI interface transitions from the ULPS-exit state to the TX-stop state (signaling code LP-11). 3. After a short period of time (the programmed integration time plus a fixed overhead), frames of pixel data start to be transmitted on the MIPI interface. Each frame of pixeldata is transmitted as a number of high-speed packets. The transition from the TXstop state to the high-speed signaling states occurs in accordance with the MIPI specifications. Between high-speed packets and between frames, the MIPI interface idles in the TX-stop state. The transition from the high-speed signaling states and the TX-stop state takes place in accordance with the MIPI specifications. 4. If the sensor is reset, any frame in progress is aborted immediately and the MIPI signals switch to indicate the ULPS. 5. If the sensor is taken out of the streaming system state and reset_register[4] = 1 (standby end-of-frame), any frame in progress is completed and the MIPI signals switch to indicate the ULPS. If the sensor is taken out of the streaming system state and reset_register[4] = 0 (standby end-of-frame), any frame in progress is aborted as follows: 1. Any long packet in transmission is completed. 2. The end of frame short packet is transmitted. After the frame has been aborted, the MIPI signals switch to indicate the ULPS. PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN 17 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Sensor Control The sensor core of the MT9M114 is a progressive-scan sensor that generates a stream of pixel data at a constant frame rate. Figure 9 shows a block diagram of the sensor core. The timing and control circuitry sequences through the rows of the array, resetting and then reading each row in turn. In the time interval between resetting a row and reading that row, the pixels in the row integrate incident light. The exposure is controlled by varying the time interval between reset and readout. Once a row has been selected, the data from each column is sequenced through an analog signal chain, including offset correction, gain adjustment, and ADC. The final stage of sensor core converts the output of the ADC into 10-bit data for each pixel in the array. The pixel array contains optically active and light-shielded (dark) pixels. The dark pixels are used to provide data for the offset-correction algorithms (black level control). The sensor core contains a set of control and status registers that can be used to control many aspects of the sensor behavior including the frame size, exposure, and gain setting. These registers are controlled by the MCU firmware and are also accessible by the host processor through the two-wire serial interface. The output from the sensor core is a Bayer pattern; alternate rows are a sequence of either green and red pixels or blue and green pixels. The offset and gain stages of the analog signal chain provide per-color control of the pixel data. Figure 9: Sensor Core Block Diagram Control Registers System Control Timing and Control Green1/Green2 Channel VGA Active-Pixel Sensor (APS) Array Analog Processing G1/G2 R/B ADC G1/G2 R/B Digital Processing 10-Bit Data Out Red/Blue Channel Sensor Core PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN 18 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor The sensor core uses a Bayer color pattern, as shown in Figure 10. The even-numbered rows contain green and red pixels; odd-numbered rows contain blue and green pixels. Even-numbered columns contain green and blue pixels; odd-numbered columns contain red and green pixels. Pixel Color Pattern Detail (Bottom Left Corner) Row readout direction Figure 10: First active pixel (Col 8, Row 2) Black and empty pixels For the MT9M114 the first active pixel is defined as the first pixel that would be used as part of the demosaic border. When the sensor is operating in a system, the active surface of the sensor faces the scene as shown in Figure 11 on page 20. When the image is read out of the sensor, it is read one row at a time, with the rows and columns sequenced. PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN 19 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Figure 11: Imaging a Scene Lens Scene Sensor (rear view) Row Readout Order Column Readout Order Pixel (0,0) The sensor core supports different readout options to modify the image before it is sent to the IFP. The readout can be limited to a specific window size of the original pixel array. By changing the readout directions, the image can be flipped in the vertical direction and/or mirrored in the horizontal direction. The image output size is set by programming row and column start and end address variables. When the sensor is configured to mirror the image horizontally, the order of pixel readout within a row is reversed, so that readout starts from the last column address and ends at the first column address. Figure 12 shows a sequence of 3 pixels being read out with normal readout and reverse readout. This change in sensor core output is corrected by the IFP. Figure 12: Three Pixels in Normal and Column Mirror Readout Mode LINE_VALID Normal readout DOUT[7:0] G0 (9:2) G0 (1:0) R0 (9:2) R0 (1:0) G1 (9:2) G1 (1:0) G1 (9:2) G1 (1:0) R0 (9:2) R0 (1:0) G0 (9:2) G0 (1:0) Reverse readout DOUT[7:0] When the sensor is configured to flip the image vertically, the order in which pixel rows are read out is reversed, so that row readout starts from the last row address and ends at the first row address. Figure 13 on page 21 shows a sequence of 3 rows being read out with normal readout and reverse readout. This change in sensor core output is corrected by the IFP. PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN 20 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Figure 13: Three Rows in Normal and Row Mirror Readout Mode FRAME_VALID Normal readout DOUT[7:0] Row0 (9:2) Row0 (1:0) Row1 (9:2) Row1 (1:0) Row2 (9:2) Row2 (1:0) Row2 (1:0) Row2 (9:2) Row1 (1:0) Row1 (9:2) Row0 (1:0) Row0 (9:2) Reverse readout DOUT[7:0] The MT9M114 sensor core supports subsampling with skipping to increase the frame rate. The proper image output size and cropped size must be programmed before enabling subsampling mode. Figure 14 shows the readout with 2X skipping. Figure 14: Eight Pixels in Normal and Column Skip 2X Readout Mode LINE_VALID Normal readout DOUT[9:0] G0 (9:2) G0 (1:0) R0 (9:2) R0 (1:0) G1 (9:2) G1 (1:0) R1 (9:2) R1 (1:0) G0 (9:2) G0 (1:0) R0 (9:2) R0 (1:0) G2 (9:2) G2 (1:0) R2 (9:2) R2 (1:0) G2 (9:2) G2 (1:0) R2 (9:2) R2 (1:0) G3 (9:2) G3 (1:0) R3 (9:0) R3 (9:0) LINE_VALID Column skip readout DOUT[7:0] PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN 21 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Pixel Readouts The following diagrams show a sequence of data being read out with no skipping. The effect of the different subsampling on the pixel array readout is shown in Figure 15 through Figure 20 on page 25. Figure 15: Pixel Readout (No Skipping) X Incrementing Y Incrementing PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN 22 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Figure 16: Pixel Readout (Column Skipping) X Incrementing Y Incrementing Figure 17: Pixel Readout (Row Skipping) X Incrementing Y Incrementing PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN 23 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Figure 18: Pixel Readout (Column and Row Skipping) X Incrementing Y Incrementing PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN 24 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Binning and Summing The MT9M114 sensor core supports binning and summing. Binning has many of the same characteristics as subsampling but it gathers image data from all pixels in the active window (rather than a subset of them). Pixel binning will sample pixels and average the value together in the analog domain. Summing will add the charge or voltage values of the neighboring pixels together. (e means "charge summing", v means "voltage summing", and avg means "digital averaging (post ADC). The advantage of using summing is that the pixel data is added together and up to 4X increase in responsivity is achieved. - - Figure 19: Pixel Binning and Summing 2 x2 B in n in g o r S u m m in g B in n in g S u m m in g v av g av g avg avg av g Figure 20: avg v Pixel Readout (Column and Row Binning) Y incrementing X incrementing PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN 25 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Image Flow Processor Image control processing in the MT9M114 is implemented in the IFP hardware logic. For normal operation, the microcontroller automatically adjusts the operational parameters of the IFP. Figure 21 shows the image data processing flow within the IFP. Figure 21: Image Flow Processor RAW 10 1.2Mp Pixel Array ADC Raw Bayer 10 IFP Color Bar Test Pattern Generator MUX Raw Bayer 10 (8+2 output format) Digital Gain Control, Adaptive Shading Correction Defect Correction, Nosie Reduction, Color Interpolation Statistics Engine 8-bit RGB RGB to YUV 10/12-Bit RGB 8-bit YUV Color Correction Scaler/ Perspective Correction Aperture Correction Hue Rotate Output Formatting YUV to RGB Gamma Correction (10-to-8 Lookup) Output Interface TX FIFO MIPI Parallel Output Mux MIPI Output PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN Color Kill Parallel Output 26 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor For normal operation of the MT9M114, streams of raw image data from the sensor core are continuously fed into the color pipeline. The MT9M114 features an automatic color bar test pattern generation function to emulate sensor images as shown in Figure 22: "Color Bar Test Pattern," on page 27. The color bar test pattern is fed to the IFP for testing the image pipeline without sensor operation. Color bar test pattern generation can be selected by programming variables. To select enter test pattern mode R0xC84C = 0x02; to exit this mode R0xC84C must be set to 0x00. A Change-Config command needs to be issued when switching to CAM mode to enable test pattern as well as when exiting. Figure 22: Color Bar Test Pattern Test Pattern Example Flat Field R0xC84C = 0x02 R0xC84D = 0x01 R0xC84E = 0x01FF R0xC850 = 0x01FF R0xC852 = 0x01FF Load= Change-Config Changing the values in 0x4E-0x52 will change the color of the test pattern. 100% Color Bar R0xC84C = 0x02 R0xC84D = 0x04 Load=Change-Config Pseudo-Random R0xC84C = 0x02 R0xC84D = 0x05 Load=Change-Config Fade-to-Gray R0xC84C = 0x02 R0xC84D = 0x08 Load = Change-Config Walking ones 10-bit R0xC84C = 0x02 R0xC84D = 0x0A Load = Change-Config Walking ones 8-bit R0xC84C = 0x02 R0xC84D = 0x0B Load = Change-Config PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN 27 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Digital Gain Image stream processing starts with multiplication of all pixel values by a programmable digital gain. Independent color channel digital gain can be adjusted with registers. Adaptive PGA (APGA) Lenses tend to produce images whose brightness is significantly attenuated near the edges. There are also other factors causing fixed pattern signal gradients in images captured by image sensors. The cumulative result of all these factors is known as image shading. The MT9M114 has an embedded shading correction module that can be programmed to counter the shading effects on each individual R, Gb, Gr, and B color signal. In some cases, different illuminants can introduce different color shading response. The APGA feature on the MT9M114 will compensate for the dependency of the lens shading of the illuminant. The MT9M114 will allow for up to three different illuminants to be compensated. Color Interpolation and Edge Detection In the raw data stream fed by the sensor core to the IFP, each pixel is represented by a 10-bit integer, which can be considered proportional to the pixel's response to a onecolor light stimulus, red, green, or blue, depending on the pixel's position under the color filter array. Initial data processing steps, up to and including the defect correction, preserve the one-color-per-pixel nature of the data stream, but after the defect correction it must be converted to a three-colors-per-pixel stream appropriate for standard color processing. The conversion is done by an edge-sensitive color interpolation module. The module adds the incomplete color information available for each pixel with information extracted from an appropriate set of neighboring pixels. The algorithm used to select this set and extract the information seeks the best compromise between preserving edges and filtering out high-frequency noise in flat field areas. The edge threshold can be set through variable settings. Color Correction and Aperture Correction To achieve good color fidelity of the IFP output, interpolated RGB values of all pixels are subjected to color correction. The IFP multiplies each vector of three pixel colors by a 3 x 3 color correction matrix. The three components of the resulting color vector are all sums of three 10-bit numbers. Since such sums can have up to 12 significant bits, the bit width of the image data stream is widened to 12 bits per color (36 bits per pixel). The color correction matrix can either be programmed by the user or automatically selected by the AWB algorithm implemented in the IFP. Traditionally this would have been based off two sets of CCM, one for Warm light like Tungsten and the other for Daylight (the part would interpolate between the two matrixes). This is not an optimal solution for cameras used in a Cool White Fluorescent (CWF) environment, for example when using a webcam. A better solution is to provide three CCMs, which would include a matrix for CWF (interpolation now between three matrixes). The MT9M114 offers this feature which will give the user improved color fidelity when under CWF type lighting. PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN 28 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Color correction should ideally produce output colors that are independent of the spectral sensitivity and color crosstalk characteristics of the image sensor. The optimal values of the color correction matrix elements depend on those sensor characteristics and on the spectrum of light incident on the sensor. The color correction settings can be adjusted using variables. To increase image sharpness, a programmable 2D aperture correction (sharpening filter) is applied. The gain and threshold for 2D correction can be defined through variable settings. Gamma Correction The gamma correction curve (as shown in Figure 23) is implemented as a piecewise linear function with 19 knee points, taking 12-bit arguments and mapping them to 8-bit output. The abscissas of the knee points are fixed at 0, 64, 128, 256, 512, 768, 1024, 1280, 1536, 1792, 2048, 2304, 2560, 2816, 3072, 3328, 3584, 3840, and 4096. The 8-bit ordinates are programmable through variables. The MT9M114 IFP includes a block for gamma correction that has the capability to adjust its shape, based on brightness, to enhance the performance under certain lighting conditions. Two custom gamma correction tables may be uploaded, one corresponding to a contrast curve for brighter lighting conditions, the other one corresponding to a noise reduction curve for lower lighting conditions. Also included in this block is a Fade-to Black curve which sets all knee points to zero and causes the image to go black in extreme low light conditions. The MT9M114 has the ability to calculate the 19 point knee points based on a small number of variable inputs from the host, another option is for the host to program one or both of the 19 knee points. The diagram below shows how the gamma feature interacts in MT9M114. PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN 29 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Figure 23: Gamma Interaction C a m_ll_sta rt_co n tra st _lu m a_p e rce n ta g e C a m_ll_sto p_co n tra st _lu m a_p e rce n ta g e C a m_ll_sta rt_co n tra st _g ra d ie n t C a m_ll_m o d e[1:0] C a m_ll_sto p_co n tra st _g ra d ie n t C a m_ll_g a m m a C ontrast Enhancem ent M T9M114 calculates19 knee point gam m a curves 19 k nee point c alc ulation N oise R eduction L l_g a m m _ase le ct C ontrast Enhancem ent G am m a c urv e s elec tion N oise R eduction L l_e n a b le_fa d e_to_b la ck Fade to B lac k s elec tion F inal gam m a curve C am_ll_ start_ contrast_gradient Gamma Knee Point Calculation The MT9M114 allows for the 19 knee point curves to be programmed based off a small number of variables. The table below shows the variables which are required. Table 8: Variables Required for Gamma Knee Point Calculation Variable Name VAR(0x12,0x0124) or (R0xC924) cam_ll_llmode VAR(0x12,0x013C) or (R0xC93C) VAR(0x12,0x013E) or (R0xC93E) VAR(0x12,0x0140) or (R0xC940) cam_ll_start_contrast_bm 0x00: User will program 19 knee point gamma curves 0x01: MT9M114 will calculate 19 knee point for contrast curve (first curve or table). 0x02: MT9M114 will calculate 19 knee point for noise reduction curve (second curve or table). 0x03: MT9M114 will calculate both 19 knee point curves. Interpolation start point for first curve cam_ll_stop_contrast_bm Interpolation stop point for second curve PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN cam_ll_gamma Function The value of the gamma curve, this is applied to both 19 knee point curves. The default is 220, this equates to a gamma of 2.2. 30 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Table 8: Variables Required for Gamma Knee Point Calculation Variable Name VAR(0x12,0x0142) or (R0xC942) VAR(0x12,0x0143) or (R0xC943) VAR(0x12,0x0144) or (R0xC944) VAR(0x12,0x0145) or (R0xC945) VAR(0x12,0x0156) or (R0xC956) cam_ll_start_contrast_gradient Function The value of the contrast gradient which would be used for the first curve cam_ll_stop_contrast_gradient The value of the contrast gradient which would be used for the second curve cam_ll_start_contrast_luma_per The percentage of target luma for the inflexion point in the first curve centage cam_ll_start_contrast_luma_per The percentage of target luma for the inflexion point second curve centage cam_ll_inv_brightness_metric Measure of scene brightness, reference points for cam_ll_start_contrast_bm and cam_ll_stop_contrast_bm The concept of how the variables cam_ll_XX_contrast_gradient and cam_ll_XX_contrast_luma_percentage interact to produce a curve is shown below. Figure 24: Automatic Gamma Curve Con tras t_gr ad ient 256 Target_luma 80%Target Luma Inflexion point PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN 31 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Figure 25 shows the interaction of the variables and cam_ll_inv_brightness_metric. Figure 25: Gamma Reference Variables Against Brightness Metric cam_ll_start_contrast_luma_percentage = 80 cam_ll_start_contrast_gradient = 50 cam_ll_stop_contrast_gradient = 38 cam_ll_stop_contrast_luma_percentage = 25 cam_ll_inv_brightness_metric cam_ll_stop_contrast_bm = 1178 cam_ll_start_contrast_bm = 230 Bright Light Low Light Aptina would recommend that cam_ll_start_contrast_bm is set at 100 lux and cam_ll_stop_contrast_bm is set at 20 lux, but due to the flexibility of the MT9M114 it is at the discretion of the user. Aptina recommends setting cam_ll_llmode = 0x03 as this will allow the MT9M114 to calculate both of the 19 knee point curves based on the user inputs, otherwise the user will have to program both of the 19-knee-point curves. Gamma Curve Selection The MT9M114 allows the user to select between the two-curve interpolation or either of the curves Table 9: Gamma curve Selection Variable Name VAR(0x0F,0x0007) or (R0xBC07) ll_gamma_select PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN Function 0x00= Auto curve select. The curves will interpolate based on settings of cam_ll_start_contrast_bm and cam_ll_stop_contrast_bm 0x01 = Contrast curve is only used 0x02 = Noise reduction curve is only used 32 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Fade to Black Selection The final stage of the gamma flow is the enabling and use of Fade-to-Black. The MT9M114 IFP allows for the image to fade to black under extreme low-light conditions. This feature enables users to optimize the performance of the sensor under low-light conditions. It minimizes the perception of noise and artifacts while the available illumination is diminishing. This feature has two user-set points that reference the brightness of the scene. When the Fade-to-Black starts, it will interpolate to the end point as the light falls until it gets to the end point. When at the end point, the image will be black. Table 10: Fade-to-Black Selection Variable Name VAR(0x0F,0x0007) or (R0xBC07) VAR(0x12,0x014A) or (R0xC94A) VAR(0x12,0x014C) or (R0xC94C) VAR(0x0F,0x003A) or (R0xBC3A) ll_mode Function When bit 3=1, this will enable the Fade-to-Black feature cam_ll_start_fade_to_black_luma Starting point for Fade-to-Black to begin cam_ll_stop_fade_to_black_luma End point for Fade-to-Black, after this point the image will be black ll_average_luma_fade_to_black Measure of scene brightness, reference points for cam_ll_start_fade_to_black_luma and cam_ll_stop_fade_to_black_luma Aptina would recommend that cam_ll_start_fade_to_black_luma is set at 3 lux and cam_ll_stop_fade_to_black_luma is set at 1 lux, but due to the flexibility of the MT9M114 it is at the discretion of the user. PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN 33 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Image Scaling and Cropping To ensure that the size of images output by the MT9M114 can be tailored to the needs of all users, the IFP includes a scaler module. When enabled, this module performs rescaling of incoming images--shrinks them to the selected width (the output widths should be in multiples of 4) and height without reducing the field of view and without discarding any pixel values. By configuring the cropped and output windows to various sizes, different zooming levels for 4X, 2X, and 1X can be achieved. The location of the cropped window is configurable so that panning is also supported. The height and width definitions for the output window must be equal to or smaller than the cropped image. The image cropping and scaler module can be used together to implement a digital zoom and pan. Hue Rotate The MT9M114 has integrated hue rotate. This feature will help for improving the color image quality and give customers the flexibility for fine color adjustment and special color effects. Table 11: Hue Control Variable Name Function VAR(0x12,0x73) or R0xC873 Hue Angle Adjusts the global hue angle adjustment. 0xEA = -22 0x00 = 0 0x16 = +22 Vertical Perspective Correction The MT9M114 has vertical perspective correction (VPC) also known as the Tilt Connection; this allows the user to correct (within limits) for an off-horizontal axis camera. Original Image PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN VPC Corrected Image 34 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor VPC is performed using a mixture of scale and crop, the variables that control this are: Variable Name VAR(0x12,0x005E) or (R0xC85E) cam_scale_vertical_tc_mode VAR(0x12,0x0060) or (R0xC860) VAR(0x12,0x0062) or (R0xC862) Function When set, the vertical stretching factor is applied to the centre of the image, so top/ bottom lines are cropped. When clear, the crop occurs in the top or bottom of the scene dependent on the percentage value (cam_scale_vertical_tc_percentage). cam_scale_vertical_tc_percentage The amount of tilt (perspective) correction to be applied. If negative, this value represents % of FOV reduction with the bottom line unaffected. If positive, this value represents % of FOV reduction with the top line unaffected. cam_scale_vertical_tc_stretch_factor Ratio of vertical stretching against the percentage applied. Vertical stretching = stretch factor x percentage/2. The effect of using cam_scale_vertical_tc_percentage can be seen below. Uncorrected image Ve rtic al pla ne Case1: CAM_SCALE_VERTICAL_TC_PERCENTAGE = 10% Corrected vertical plane 90% w Vertical plane is tilted-away from the camera - therefore the bottom row of image represents the nearest point. The nearest point appears bigger in the uncorrected image, therefore top/bottom ratio will be greater than 1.0 w Case2: CAM_SCALE_VERTICAL_TC_PERCENTAGE = -10% Uncorrected image ne pla al rtic Ve Corrected vertical plane w Vertical plane is tilted-towards the camera - therefore the top row of image represents the nearest point. The nearest point appears bigger in the uncorrected image, therefore the top/bottom ratio with be less than 1.0 90% w Cam_scale_vertical_tc_percentage defines how much tilt needs to be corrected for in percentage terms. PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN 35 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor The effect of using cam_scale_vertical_tc_mode can be seen below. Original scene tilted MODE_STRETCH_FROM_CENTRE_EN = 0 PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN MODE_STRETCH_FROM_CENTRE_EN = 1 36 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Camera Control and Auto Functions Auto Exposure The auto exposure algorithm performs automatic adjustments of the image brightness by controlling exposure time and analog gains of the sensor core as well as digital gains applied to the image. Auto exposure is implemented by a firmware driver that analyzes image statistics collected by the exposure measurement engine, makes a decision, and programs the sensor core and color pipeline to achieve the desired exposure. The measurement engine subdivides the image into 25 windows organized as a 5 x 5 grid. Four auto exposure algorithm modes are available: * Average brightness tracking (ABT) or Average Y (ae_rule_algo VAR= 9, 0x0004, 0x0000 or REG= 0xA404, 0x0000) The average brightness tracking AE uses a constant average tracking algorithm where a target brightness value is compared to a current brightness value, and the gain and integration time are adjusted accordingly to meet the target requirement. * Weighted Average Brightness (ae_rule_algo VAR= 9, 0x0004, 0x0001 or REG= 0xA404, 0x0001) Each of the 25 windows can be assigned a weight relative to other window weights, which can be changed independently of each other. For example, the weights can be set to allow the center of the image to be weighted higher than the periphery. See Figure 26. Figure 26: 5 x 5 Grid * Adaptive Weighted AE for highlights (ae_rule_algo VAR= 9, 0x0004, 0x0002 or REG= 0xA404, 0x0002)- The scene will be exposed based on the brightness of each window, and will adapt to correctly expose the highlights (brighter windows). This would correctly expose the foreground of an image when the background is dark. * Adaptive Weighted AE for lowlights(ae_rule_algo VAR= 9, 0x0004, 0x0003 or REG= 0xA404, 0x0003)- The scene will be exposed based on the brightness of each window, and will adapt to correctly expose the lowlights. This would correctly expose the foreground of an image when the background is brighter. PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN 37 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Sample images below show the benefits of the different AE modes. Light Background Average Brightness Tracking or Average Y Weighted Average Brightnes s(centre) Adaptive weighted based on zone luma (highlights) Adaptive weighted based on zone luma (lowlights) Note: This mode is intended to expose the background vs. the foreground In the use case above the Adaptive weighted for lowlights exposes the face slightly better when compared to the Weighted Average Brightness. However, if the foreground subject is moved off-center: Weighted Average Brightness (centre) (lowlights) Adaptive weighted based on zone luma This shows the advantage of using the Adaptive Weighted AE for lowlights(ae_rule_algo = 0x03); when the face moves off center it still is exposed correctly. PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN 38 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Dark Background Average Brightness Tracking or Average Y Adaptive weighted based on zone luma (highlights) Weighted Average Brightnes s(centre) Adaptive weighted based on zone luma (lowlights) Note: This mode is correctly exposing the background of the image, hence you can see the shadows. In this use case the Adaptive Weighted AE for highlights will expose the face the best when compared to the other options. AE Track Driver Other algorithm features include the rejection of fast fluctuations in illumination (time averaging), control of speed of response, and control of the sensitivity to the small changes. While the default settings are adequate in most situations, the user can program target brightness, measurement window, and other parameters described above. The driver changes AE parameters (integration time, gains, and so on) to drive scene brightness to the programmable target. To avoid unwanted reaction of AE on small fluctuations of scene brightness or momentary scene changes, the AE track driver uses a temporal filter for luma and a threshold around the AE luma target. The driver changes AE parameters only if the filtered luma is larger than the AE target step and pushes the luma beyond the threshold. PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN 39 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Auto White Balance The MT9M114 has a built-in AWB algorithm designed to compensate for the effects of changing spectra of the scene illumination on the quality of the color rendition. The algorithm consists of two major parts: a measurement engine performing statistical analysis of the image and a driver performing the selection of the optimal color correction matrix and SOC digital gain. While default settings of these algorithms are adequate in most situations, the user can reprogram base color correction matrices, place limits on color channel gains, and control the speed of both matrix and gain adjustments. The MT9M114 AWB displays the current AWB position in color temperature, the range of which will be defined when programming the CCM matrixes. Flicker Avoidance Flicker occurs when the integration time is not an integer multiple of the period of the light intensity. The MT9M114 can be programmed to avoid flicker for 50 or 60 Hertz. For integration times below the light intensity period (10ms for 50Hz environment), flicker cannot be avoided. The MT9M114 supports an indoor AE mode, that will ensure flicker-free operation (VAR8= 18, 0x0078[0]=0x1 o REG= 0xC878[0]= 0x1). The MT9M114 will calculate all flicker parameters based on the sensor settings which are programmed in the Cam Control variables. This means the user only needs to select if 50- or 60-Hz flicker needs to be avoided (VAR 0x12, 0x008B or R0xC88B = 50 for 50-Hz flicker avoidance and 60 for 60-Hz avoidance). PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN 40 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Output Conversion and Formatting The YUV data stream can either exit the color pipeline as is or be converted before exit to an alternative YUV or RGB data format. Color Conversion Formulas Y'U'V' This conversion is BT 601 scaled to make YUV range from 0 through 255. This setting is recommended for JPEG encoding and is the most popular, although it is not well defined and often misused in various operating systems. Y = 0.299 x R + 0.587 x G + 0.114 x B (EQ 1) U = 0.564 x (B - Y ) + 128 (EQ 2) V = 0.713 x (R - Y ) + 128 (EQ 3) There is an option where 128 is not added to U'V'. Y'Cb'Cr' Using sRGB Formulas The MT9M114 implements the sRGB standard. This option provides YCbCr coefficients for a correct 4:2:2 transmission. Note: 16 < Y601< 235; 16 < Cb < 240; 16 < Cr < 240; and 0 < = RGB < = 255 Y = (0.2126 x R + 0.7152 x G + 0.0722 x B ) x (219 256) + 16 (EQ 4) Cb = 0.5389 x (B - Y ) x (224 256) + 128 (EQ 5) Cr = 0.635 x (R - Y ) x (224 256) + 128 (EQ 6) Y'U'V' Using sRGB Formulas These are similar to the previous set of formulas, but have YUV spanning a range of 0 through 255. Y = 0.2126 x R + 0.7152 x G + 0.0722 x B (EQ 7) U = 0.5389 x (B - Y ) + 128 = - 0.1146 x R - 0.3854 x G + 0.5 x B (EQ 8) V = 0.635 x (R - Y ) + 128 = 0.5 x R - 0.4542 x G - 0.0458 x B (EQ 9) There is an option to disable adding 128 to U'V'. The reverse transform is as follows: PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN R = Y + 1.5748 x ( V - 128 ) (EQ 10) G = Y - 0.1873 x (U - 128 ) - 0.4681 x (V - 128) (EQ 11) B = Y + 1.8556 x (U - 128) (EQ 12) 41 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Uncompressed YUV/RGB Data Ordering The MT9M114 supports swapping YCbCr mode, as illustrated in Table 12. Table 12: YCbCr Output Data Ordering Mode Data Sequence Default (no swap) Swapped CrCb Swapped YC Swapped CrCb, YC Yi Yi Cbi Cri Cbi Cri Yi Yi Cri Cbi Yi+1 Yi+1 Yi+1 Yi+1 Cri Cbi The RGB output data ordering in default mode is shown in Table 13. The odd and even bytes are swapped when luma/chroma swap is enabled. R and B channels are bitwise swapped when chroma swap is enabled. Table 13: RGB Ordering in Default Mode Mode (Swap Disabled) Byte D7D6D5D4D3D2D1D0 565RGB Odd Even Odd Even Odd Even Odd Even R7R6R5R4R3G7G6G5 G4G3G2B7B6B5B4B3 0 R7R6R5R4R3G7G6 G4G3G2B7B6B5B4B3 R7R6R5R4G7G6G5G4 B7B6B5B4 0 0 0 0 0 0 0 0 R7R6R5R4 G7G6G5G4B7B6B5B4 555RGB 444xRGB x444RGB Uncompressed Raw Bayer Bypass Output Raw 10-bit Bayer data from the sensor core can be output in bypass mode by: 1. Using both DOUT[7:0] and DOUT_LSB[1:0]. 2. Using only DOUT[7:0] with a special 8 + 2 data format, shown in Table 14. 3. Using the MIPI interface. Table 14: 2-Byte Bayer Format 2-Byte Bayer Format Odd bytes Even bytes PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN Bits Used Bit Sequence 8 data bits 2 data bits + 6 unused bits D9D8D7D6D5D4D3D2 0 0 0 0 0 0 D1D0 42 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor UVC Interface The MT9M114 supports a set of UVC (USB Video Class) controls in order to simplify the integration of the MT9M114 with a host's USB bridge (or ISP) device. The MT9M114 firmware includes a 'UVC Control' component that augments the CamControl variables. The UVC Control component sits above the CamControl interface (in terms of abstraction) and acts as a 'virtual host'. The intention is that CamControl and all other components are unaware of the UVC Control component. UVC Control exposes a 'UVC control' page of shared variables to the host. This page contains variables compliant with the UVC 1.1 specification (where possible). The variables on this page are named to match the UVC specification, and have matching data sizes, units and ranges as required. Each UVC variable is 'virtual' - it does not control any MT9M114 function directly. MT9M114 therefore provides a 'dual-personality' host interface: The primary CamControl interface, this interface exposes the full feature-set of the device. The secondary UVC Control interface, which simplifies integration of MT9M114 into a PC-Cam application. More details on this topic can be found in the Developer Guide. Table 15: PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN Summary of UVC Commands Variable Name R0xCC00 VAR(0x13,0x0000) R0xCC01 VAR(0x13,0x0001) R0xCC02 VAR(0x13,0x0002) R0xCC03 VAR(0x13,0x0003) R0xCC04 VAR(0x13,0x0004) R0xCC08 VAR(0x13,0x0008) R0xCC0A VAR(0x13,0x000A) R0xCC0C VAR(0x13,0x000C) R0xCC0E VAR(0x13,0x000E) R0xCC10 VAR(0x13,0x0010) R0xCC12 VAR(0x13,0x0012) R0xCC14 VAR(0x13,0x0014) R0xCC16 VAR(0x13,0x0016) UVC_AE_MODE_CONTROL UVC_WHITE_BALANCE_TEMPERATURE_AUTO_CONTROL UVC_AE_PRIORITY_CONTROL UVC_POWER_LINE_FREQUENCY_CONTROL UVC_EXPOSURE_TIME_ABSOLUTE_CONTROL UVC_BACKLIGHT_COMPENSATION_CONTROL UVC_BRIGHTNESS_CONTROL UVC_CONTRAST_CONTROL UVC_GAIN_CONTROL UINT16 UVC_HUE_CONTROL UVC_SATURATION_CONTROL UINT16 UVC_SHARPNESS_CONTROL UVC_GAMMA_CONTROL 43 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Table 15: Summary of UVC Commands (continued) Variable Name R0xCC18 VAR(0x13,0x0018) R0xCC1C VAR(0x13,0x001C) R0xCC20 VAR(0x13,0x0020) R0xCC21 VAR(0x13,0x0021) UVC_WHITE_BALANCE_TEMPERATURE_CONTROL UVC_FRAME_INTERVAL_CONTROL UVC_MANUAL_EXPOSURE_CONFIG UVC_FLICKER_AVOIDANCE_CONFIG Multi-Camera Sync The MT9M114 supports more than one device to be connected in a "daisy-chain" type configuration. One of the devices will act as the master and the remainder will be slaves. A typical connection diagram is shown inFigure 27. All of the MT9M114 that are to communicate are: * Connected in a daisy-chain using SADDR as an input and CHAIN as an output. * Clocked from a common clock source * Controlled from a single master, presumed to be under software control of a host system. Figure 27: Multi-Camera Connection Host SCLK SDATA SCLK SDATA MT9M114 EXTCLK SADDR SCLK SDATA MT9M114 EXTCLK SADDR CHAIN MT9M114 EXTCLK SADDR CHAIN Logic1 SCLK SDATA MT9M114 EXTCLK SADDR CHAIN Logic1 CHAIN Logic1 GND MT9M114 (1) ( Master) device = ID0 MT9M114(2) device = ID1 MT9M114(3) device = ID1 MT9M114(4) device = ID1 SADDR is normally used as a static input that selects between two slave device addresses (See Figure 28. In order to implement the multi-sync function this input now has additional functionality that does not interfere with its use as device address selection. PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN 44 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Figure 28: Normal Use of SADDR R0x002E (USER_DEFINED_DEVICE_ADDRESS_ID) ID0 (Default: 0x90) slave Device ID ID1 (Default: 0xBA) SADDR There is a single register to control this function, named CHAIN_CONTROL (R0x31FC). This register is controlled by the host. The register field assignment is shown in Table 16. Table 16: CHAIN_CONTROL Register Bit Name Default Description 15 chain_enable 0 14 sync_enable 0 13 master 0 12 11:8 RESERVED position 0 7:0 RESERVED 0: multi-camera daisy-chain communication function is disabled. 1: multi-camera daisy-chain communication function is enabled. The result of toggling this bit while the sensor is streaming is UNDEFINED. 0: multi_sync function is disabled. 1: multi-sync function is enabled. The result of toggling this bit while the sensor is streaming is UNDEFINED. 0: this node is not the master. 1: this node is the master. The result of toggling this bit while the sensor is streaming is UNDEFINED. A unique value assigned to each device in the daisy-chain. The device furthest from the master is assigned a position value of 0. The next device is assigned a position value of 1. For N devices in a daisy-chain, the master is assigned a position value of N-1. The result of toggling this bit while the sensor is streaming is UNDEFINED. Configuration Before the multi-sync function can be used, each MT9M114 in the daisy-chain must be configured. This process is performed by the host with no involvement from MT9M114 firmware. Configuration involves assigning a unique slave address to each MT9M114 and configuring the CHAIN_CONTROL register on each MT9M114. After reset (before configuration) the master MT9M114 has its SADDR input wired to '0' and all other MT9M114 in the daisy-chain have their SADDR inputs driven to '1'. Therefore, MT9M114 Master will respond to slave address ID0 (associated with SADDR = 0) and all the other MT9M114 in the daisy-chain will respond simultaneously to slave address ID1. Each MT9M114 has its CHAIN pin configured as an input. This situation is shown in Figure 27. The host configures each MT9M114 in sequence, starting with the master and ending with the farthest slave in the daisy-chain: * MT9M114(1) Master: The host uses slave address ID0 (associated with SADDR = 0) and therefore accesses registers on MT9M114(1) (the master). It writes to register (R0x002E) to change the slave addresses associated with ID0 and ID1 on this device to a single, new, unique value; call it ID-MT9M114(1). It then writes (using MT9M114(1) to register PAD_CONTROL (R0x0032) to configure CHAIN as an output. Finally, it writes (using MT9M114(1)) to the CHAIN_CONTROL register to set chain_enable =1, PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN 45 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor sync_enable=1, master=1 and position = N - 1 (where there are N devices in the daisychain). The effect of enabling TMS as an output is to drive the TMS output low. * MT9M114(2): This MT9M114 now has SADDR=0 and so will respond to slave address ID0. The host configures this in the same way as MT9M114(1) with the exceptions that it assigns ID-MT9M114(2), sets master=0 and position = N-2 (where there are N devices in the daisy-chain). As before, the effect of enabling CHAIN as an output is to drive the CHAIN output low. * MT9M114(3): As for MT9M114(2): assign ID-MT9M114(3), master=0, position = N-3 * MT9M114(4): As for MT9M114(2): assign ID-MT9M114(4), master=0, position = N-4 Theory Of Operation When multiple MT9M114 devices have been connected and configured as described above, the multi-sync function operates as follows: When the master device is placed in streaming mode (as the result of a mode change initiated by the host) it generates an event on its CHAIN output. It then delays its own streaming until the last of the slave devices has received an event signal. When a slave device is placed in streaming mode (as the result of a mode change initiated by the host) it delays streaming until it has received an event on its SADDR input. Each slave in the daisy-chain propagates events received on its input. Each slave uses its local value of "position" to delay its respond to an event. This allows an event propagated down the daisy-chain to be acted upon simultaneously by all devices in the daisy-chain. Using Multi-Sync The host can use the normal mechanism to configure the MT9M114 and set them streaming. It can do this in any order provided that it sets the master streaming last. It is desirable (but not essential) for the master to be taken out of streaming mode first (by using a host command). At the time that the MT9M114 are placed in streaming mode, all MT9M114 must have the same integration time The recommended mechanism is: 1) Boot each device into standby by enabling 'host-config' mode. 2) Reconfigure each device. 3) Wake each device and commence streaming using the Leave Standby command. The MT9M114 need not maintain the same integration time once they are streaming. All the MT9M114 must be operated with the same configuration (image size, output format, PLL bypassed and frame timing). Any time that the configuration is to be changed, all MT9M114 must be taken out of streaming mode (using host command), reconfigured, then placed back in streaming mode (master last). This will allow the output data to remain in synchronisation. Clocking The multi-sync mechanism requires that all MT9M114 devices in the daisy-chain are operated synchronously on the same input clock. This constraint is imposed in order to allow the event codes to be propagated synchronously from the master through to each slave. PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN 46 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Once this constraint has been met, the MT9M114 devices are required to operate in exact synchronisation (such that a PIXCLK, FRAME_VALID and LINE_VALID out of one MT9M114 is valid for all MT9M114 in the daisy-chain). In this case, the MT9M114 internal PLL must be bypassed (and the MT9M114 must be using parallel output data). Hardware Functions Two-Wire Serial Interface The two-wire serial interface bus enables read and write access to control and status registers and variables within the MT9M114. The interface protocol uses a master/slave model in which a master controls one or more slave devices. The MT9M114 always operates in slave mode. The host (master) generates a clock (SCLK) that is an input to the MT9M114 and is used to synchronize transfers. Data is transferred between the master and the slave on a bidirectional signal (SDATA). The host should always ensure that the following relationship is adhered to. SCLK (PIXEL CLOCK/22) Protocol Data transfers on the two-wire serial interface bus are performed by a sequence of lowlevel protocol elements, as follows: 1. a (repeated) start condition 2. a slave address/data direction byte 3. a 16-bit register address (8-bit addresses are not supported) 4. an (a no) acknowledge bit 5. a 16-bit data transfer (8-bit data transfers are not supported) 6. a stop condition The bus is idle when both SCLK and SDATA are HIGH. Control of the bus is initiated with a start condition, and the bus is released with a stop condition. Only the master can generate the start and stop conditions. A start condition is defined as a HIGH-to-LOW transition on SDATA while SCLK is HIGH. At the end of a transfer, the master can generate a start condition without previously generating a stop condition; this is known as a repeated start or restart condition. A stop condition is defined as a LOW-to-HIGH transition on SDATA while SCLK is HIGH. Data is transferred serially, 8 bits at a time, with the most significant bit (MSB) transmitted first. Each byte of data is followed by an acknowledge bit or a no-acknowledge bit. This data transfer mechanism is used for the slave address/data direction byte and for message bytes. One data bit is transferred during each SCLK clock period. SDATA can change when SCLK is LOW and must be stable while SCLK is HIGH. Slave Address Bits [7:1] of this byte represent the device slave address and bit [0] indicates the data transfer direction. A "0" in bit [0] indicates a WRITE, and a "1" indicates a READ. If the SADDR signal is driven LOW, then addresses used by the MT9M114 are R0x090 (write address) and R0x091 (read address). If the SADDR signal is driven HIGH, then addresses used by the MT9M114 are R0x0BA (write address) and R0x0BB (read address). PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN 47 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Message Byte Message bytes are used for sending register addresses and register write data to the slave device and for retrieving register read data. The protocol used is outside the scope of the two-wire serial interface specification. Acknowledge Bit Each 8-bit data transfer is followed by an acknowledge bit or a no-acknowledge bit in the SCLK clock period following the data transfer. The transmitter (which is the master when writing, or the slave when reading) releases SDATA. The receiver indicates an acknowledge bit by driving SDATA LOW. As for data transfers, SDATA can change when SCLK is LOW and must be stable while SCLK is HIGH. No-Acknowledge Bit The no-acknowledge bit is generated when the receiver does not drive SDATA low during the SCLK clock period following a data transfer. A no-acknowledge bit is used to terminate a read sequence. Stop Condition A stop condition is defined as a LOW -to-HIGH transition on SDATA while SCLK is HIGH. Typical Serial Transfer A typical read or write sequence begins by the master generating a start condition on the bus. After the start condition, the master sends the 8-bit slave address/data direction byte. The last bit indicates whether the request is for a read or a write, where a "0" indicates a write and a "1" indicates a read. If the address matches the address of the slave device, the slave device acknowledges receipt of the address by generating an acknowledge bit on the bus. If the request was a write, the master then transfers the 16-bit register address to which a write should take place. This transfer takes place as two 8-bit sequences and the slave sends an acknowledge bit after each sequence to indicate that the byte has been received. The master then transfers the data as an 8-bit sequence; the slave sends acknowledge bit at the end of the sequence. After 8 bits have been transferred, the slave's internal register address is automatically incremented, so that the next 8 bits are written to the next register address. The master stops writing by generating a (re)start or stop condition. If the request was a read, the master sends the 8-bit write slave address/data direction byte and 16-bit register address, just as in the write request. The master then generates a (re)start condition and the 8-bit read slave address/data direction byte, and clocks out the register data, 8 bits at a time. The master generates an acknowledge bit after each 8bit transfer. The slave's internal register address is automatically incremented after every 8 bits are transferred. The data transfer is stopped when the master sends a no-acknowledge bit. Note: PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN If a customer is using direct memory writes (XDMA), AND the first write ends on an odd address boundary AND the second write starts on an even address boundary AND the first write is not terminated by a STOP, the write data can become corrupted. To avoid this, ensure that a serial write is terminated by a STOP. 48 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Single Read from Random Location This sequence (see Figure 29) starts with a dummy write to the 16-bit address that is to be used for the read. The master terminates the write by generating a restart condition. The master then sends the 8-bit read slave address/data direction byte and clocks out one byte of register data. The master terminates the read by generating a no-acknowledge bit followed by a stop condition. Figure 29 shows how the internal register address maintained by the MT9M114 is loaded and incremented as the sequence proceeds. Figure 29: Single Read from Random Location Previous Reg Address, N S Slave Address 0 A Reg Address[15:8] S = start condition P = stop condition Sr = restart condition A = acknowledge A = no-acknowledge A Reg Address, M Reg Address[7:0] A Sr Slave Address 1 A M+1 Read Data A P slave to master master to slave Single Read from Current Location This sequence (Figure 30) performs a read using the current value of the MT9M114 internal register address. The master terminates the read by generating a no-acknowledge bit followed by a stop condition. The figure shows two independent read sequences. Figure 30: Single Read from Current Location Previous Reg Address, N S Slave Address PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN 1 A Reg Address, N+1 Read Data Read Data A A [7:0] [15:8] P S 49 Slave Address N+2 1 A Read Data [15:0] A P (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Sequential Read, Start from Random Location This sequence (Figure 31) starts in the same way as the single read from random location (Figure 29). Instead of generating a no-acknowledge bit after the first byte of data has been transferred, the master generates an acknowledge bit, and continues to perform byte reads until L bytes have been read. Figure 31: Sequential Read, Start from Random Location Previous Reg Address, N S Slave Address 0 A Reg Address[15:8] M+1 A M+2 Read Data A Reg Address, M Reg Address[7:0] Slave Address M+L-2 M+3 Read Data A Sr Read Data 1 A M+L-1 Read Data A A M+1 A M+L Read Data A S Sequential Read, Start from Current Location This sequence (Figure 32) starts in the same way as the single read from current location (Figure 30). Instead of generating a no-acknowledge bit after the first byte of data has been transferred, the master generates an acknowledge bit, and continues to perform byte reads until L bytes have been read. Figure 32: Sequential Read, Start from Current Location Previous Reg Address, N S Slave Address 1 A N+1 Read Data A N+2 Read Data A Read Data N+L-1 A Read Data N+L A S Single Write to Random Location This sequence (Figure 33) begins with the master generating a start condition. The slave address/data direction byte signals a write and is followed by the high then low bytes of the register address that is to be written. The master follows this with the byte of write data. The write is terminated by the master generating a stop condition. Figure 33: Single Write to Random Location Previous Reg Address, N S PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN Slave Address 0 A Reg Address[15:8] 50 A Reg Address, M Reg Address[7:0] A Write Data M+1 A P A (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Sequential Write, Start at Random Location This sequence (Figure 34) starts in the same way as the single write to random location (Figure 33). Instead of generating a no-acknowledge bit after the first byte of data has been transferred, the master generates an acknowledge bit, and continues to perform byte writes until L bytes have been written. The write is terminated by the master generating a stop condition. Figure 34: Sequential Write, Start at Random Location Previous Reg Address, N S Slave Address 0 A Reg Address[15:8] M+1 Write Data M+2 A A Reg Address, M Reg Address[7:0] M+3 Write Data A A Write Data M+L-2 Write Data M+1 A M+L-1 A Write Data M+L A S A Patch RAM MT9M114 has Patch Ram, this allows for issues to be fixed without changing silicon version and also allows for new features to be added to the silicon. The patch would come in the format of Load and Apply sections, the user needs to implement both sections. Below includes detail of what can be achieved when in different host states. STANDBY- LOAD PATCHES ONLY STREAMING- LOAD AND APPLY PATCHES SUSPEND-LOAD AND APPLY PATCHES PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN 51 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Chief Ray Angle Table 17: Chief Ray Angle 30 28 26 24 22 20 CRA (deg) 18 16 14 12 10 8 6 4 2 0 0 10 20 30 40 50 60 70 80 Image Height (%) PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN 52 90 100 110 Image Height CRA (%) (deg) 0 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100 (mm) 0 0.076 0.152 0.228 0.304 0.380 0.456 0.532 0.608 0.684 0.760 0.836 0.912 0.988 1.064 1.140 1.216 1.292 1.368 1.444 1.520 0 2.51 4.98 7.44 9.89 12.32 14.68 16.94 19.08 21.03 22.78 24.28 25.52 26.49 27.16 27.57 27.70 27.60 27.29 26.81 26.20 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Figure 35: Typical Quantum Efficiency 65 Blue Green (B) Green (R) Red 60 Quantum Efficiency (%) 55 50 45 40 35 30 25 20 15 10 5 0 350 450 550 650 750 850 950 1050 1150 Wavelength (nm) Note: PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN This is measured on bare die. 53 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Electrical Specifications Caution Table 18: Stresses above those listed in Table 18 may cause permanent damage to the device. Absolute Maximum Ratings Rating Symbol Parameter Min Max Unit VDD_MAX Core digital voltage -0.3 2.4 V VDD_IO_MAX I/O digital voltage -0.3 4.0 V Analog voltage -0.3 4.0 V VDD__PLL_MAX PLL supply voltage -0.3 4.0 V VDD_PHY_MAX PHY supply voltage -0.3 2.4 V VIN DC input voltage -0.3 VDD_IO + 0.3 V IIN Transient input current (0.5 sec. duration) - 150 mA TOP Operating temperature (measure at junction) -30 75 C Storage temperature -40 85 C VAA_MAX TSTG1 Notes: PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN 1. This is a stress rating only, and functional operation of the device at these or any other conditions above those indicated in the product specification is not implied. Exposure to absolute maximum rating conditions for extended periods may affect device reliability. 54 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Recommended Operating Conditions Table 19: Symbol Operating Conditions Parameter Min Typ Max Units VDD Core digital voltage 1.7 1.8 1.95 V VDD_IO I/O digital voltage 2.5 2.8 3.1 V 1.7 1.8 1.95 V Analog voltage 2.5 2.8 3.1 V VDD_PLL PLL supply voltage 2.5 2.8 3.1 V VDD_PHY PHY supply voltage 1.7 1.8 1.95 V Operating temperature (at junction) -30 55 70 C VAA TJ Table 20: DC Electrical Characteristics Symbol Parameter VIH VIL IIN VOH VOL Input HIGH voltage Input LOW voltage Input leakage current Output HIGH voltage Output LOW voltage Notes: PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN Condition VIN = 0V or VIN = VDD_IO IOH = 2 mA IOH = 2 mA Min Max Unit Notes VDD_IO * 0.7 - - VDD_IO * 0.3 10 V V A V V 1 1 2 VDD_IO* 0.75 - VDD_IO * 0.25 1. VIL and VIH have min/max limitations specified by absolute ratings. 2. Excludes CONFIG and RESET_BAR as they have an internal pull-up resistor. 55 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Table 21: Operating Current Consumption Default Setup Conditions: fEXTCLK = 24 MHz, fPIXCLK = 96 MHz, VAA = VDD_IO = VDD_PLL = 2.8V, VDD = VDD_PHY = 1.8V, Tj = 70C unless otherwise stated, PN9 enabled, specified under MIPI and Parallel output conditions . Symbol Conditions VDD VAA VDD_PHY VDD_PLL VDD_IO IDD IAA IDD_PLL IDD_PHY Total power consumption1 Notes: PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN VDD_IO = 2.8V VDD_IO = 1.8V Full resolution 30 fps, parallel 720p, 30 fps, parallel VGA binned, 60 fps, parallel Full resolution, 30fps, MIPI 720p, 30 fps, MIPI VGA binned, 60 fps, MIPI Full resolution, 30 fps, parallel 720p, 30 fps, parallel VGA binned, 60 fps, parallel Full resolution, 30 fps, MIPI 720p, 30 fps, MIPI VGA binned, 60 fps, MIPI Full resolution, 30 fps, parallel 720p, 30 fps, parallel VGA, 60 fps, parallel Full resolution, 30f ps, MIPI 720p, 30 fps, MIPI VGA binned, 60 fps, MIPI Full resolution, 30 fps, parallel 720p, 30fps, parallel VGA binned, 60 fps, parallel Full resolution, 30 fps, MIPI 720p, 30 fps, MIPI VGA binned, 60 fps, MIPI Full resolution, 30 fps, parallel 720p, 30fps, parallel VGA binned, 60 fps, parallel Full resolution, 30 fps, MIPI 720p, 30 fps, MIPI VGA binned, 60 fps, MIPI Min Typ Max Unit 1.7 2.5 1.7 2.5 2.5 1.7 1.8 2.8 1.8 2.8 2.8 1.8 39 33 25 39 33 25 19 19 19 19 19 19 8 8 8 25 25 25 0.02 0.02 0.02 0.18 0.18 0.18 146 135 121 194 183 169 1.95 3.1 1.95 3.1 3.1 1.95 50 45 40 50 45 40 35 35 35 35 35 35 20 20 20 40 40 40 0.5 0.5 0.5 1 1 1 V V V V V V mA mA mA mA mA mA mA mA mA mA mA mA mA mA mA mA mA mA mA mA mA mA mA mA mW mW mW mW mW mW 1. Total power excludes VDD_IO current. 56 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Table 22: Standby Current Consumption (Parallel and MIPI) Default Setup Conditions: fEXTCLK=24 MHz, fPIXCLK=96 MHz, VAA = VDD_IO = VDD_PLL = 2.8V, VDD = VDD_PHY = 1.8V, TJ = 70C unless otherwise stated Soft Standby (CLK ON) Soft Standby (CLK OFF) Note: PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN Total standby current in parallel and MIPI mode Total power consumption in parallel and MIPI mode Total standby current in parallel and MIPI mode Total power consumption in parallel and MIPI mode Typical Max Unit 1.4 2.5 80 150 3 mA mW A W 500 All power measurements exclude IO current. 57 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Table 23: AC Electrical Characteristics EXTCLK = 6-54 MHz; VDD = VDD_PHY = 1.8V; VDD_IO = VAA = VDD_PLL = 2.8V; TJ = 25C unless otherwise stated Symbol Parameter Conditions fEXTCLK External clock frequency DEXTCLK External input clock duty cycle External input clock jitter tJITTER tPD PIXCLK to data valid PIXCLK to FV HIGH tPFH PIXCLK to LV HIGH tPLH tPFL PIXCLK to FV LOW PIXCLK to LV LOW tPLL EXTCLK TO PIXCLK propagation delay tCP PIXCLK slew rate Slew = 4 Output slew rate Slew = 4 Notes: Figure 36: Min 6 40 - - - - - - tPIXCLK = PICXCLK period Typ 50 500 2 2 2 2 2 0.1 x tPIXCLK Max Unit Notes 54 60 - 5 5 5 5 5 MHz % ps ns ns ns ns ns ns 1 VDD_IO = 2.8V, PLL bypass, 6 MHz EXTCLK, CLOAD = 35 pF VDD_IO = 1.8V, PLL bypass, 6 MHz EXTCLK, CLOAD = 35 pF - 0.647 - V/ns - 0.27 - V/ns VDD_IO = 2.8V, PLL bypass, 6 MHz EXTCLK, CLOAD = 35 pF VDD_IO = 1.8V, PLL bypass, 6 MHz EXTCLK, CLOAD = 35 pF - 0.229 - V/ns - 0.112 - V/ns 2 1. VIH/VIL restrictions apply. 2. Based on lab measurements. Could vary with noisier system-level electronics. Parallel Pixel Bus Timing Diagram Notes: PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN 1. FRAME_VALID leads LINE_VALID by 6 PIXCLKs. 2. FRAME_VALID trails LINE_VALID by 6 PIXCLKs. 3. Dout[7:0], FRAME_VALID, and LINE_VALID are shown with respect to the falling edge of PIXCLK. This feature is programmable and Dout[7:0], FRAME_VALID, and LINE_VALID can be synchronized to the rising edge of PIXCLK. 4. Propagation delay is measured from 50% of rising and falling edges. 58 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Table 24: Two-Wire Serial Interface Timing Data f EXTCLK = 50 MHz; VDD = 1.8V; VDD_IO = 1.8V; VAA = 2.8V; TJ = 70C; CLOAD = 68.5pF Symbol Parameter fSCLK t SCLK t r SRTS t SRTH t SDH tSDS tSHAW t AHSW tSTPS tSTPH tSHAR tAHSR tSDHR tSDSR t Figure 37: Conditions Serial interface input clock frequency Serial interface input clock period SCLK duty cycle SCLK/SDATA rise time Start setup time Start hold time SDATA hold SDATA setup SDATA hold to ack Ack hold to SDATA Stop setup time Stop hold time SDATA hold to ack Ack hold to SDATA SDATA hold SDATA setup Master write to slave Master write to slave Master write to slave Master write to slave Master read from slave Master read from slave Master write to slave Master write to slave Master write to slave Master write to slave Master read from slave Master read from slave Min Typ Max Unit 100 - 400 kHz 10 45 - 600 300 300 300 150 150 300 600 300 300 300 350 - 50 - - - - - - - - - - - - - 2.5 55 300 - - 650 - - - - - - - 650 - s % ns ns ns ns ns ns ns ns ns ns ns ns Two-Wire Serial Bus Timing Parameters Write Sequence tSDS tSRTS tSCLK tSRTH tSTPS tSHAW tAHSW tSDH tSTPH SCLK SDATA Write Start Write Address Bit 7 Write Address Bit 0 Read Sequence Register Value Bit 0 Register Value Bit 7 Ack Ack Stop tSDSR tSHAR tAHSR tSDHR SCLK SDATA Read Start PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN Read Address Bit 7 Read Address Bit 0 Ack 59 Register Value Bit 7 Register Value Bit 0 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor MIPI AC and DC Electrical Characteristics Table 25: MIPI High-Speed Transmitter DC Specifications Symbol Parameter Min Nom Max Units VCMTX | VCMTX(1,0)| |VOD| | VOD| VOHHS ZOS ZOS HS transmit static common-mode voltage VCMTX mismatch when output is Differential-1 or Differential-0 HS transmit differential voltage VOD mismatch when output is Differential-1 or Differential-0 HS output high voltage Single-ended output impedance Single-ended output impedance mismatch 150 200 140 200 40 50 250 5 270 10 360 62.5 10 mV mV mV mV mV % Table 26: MIPI High-Speed Transmitter AC Specifications Parameter Description tR and tF Data bit rate 20%-80% rise time and fall time Min Nom Max Units 768 0.3 Mb/s UI ps 150 Table 27: MIPI Low-Power Transmitter DC Characteristics Parameter Description Min Nom Max Units VOL VOH ZOLP Thevenin output high level Thevenin output low level Output impedance of LP transmitter 1.1 -50 110 1.2 1.3 50 V mV Table 28: MIPI Low-Power Transmitter AC Characteristics Symbol Parameter TRLP/TFLP TREOT TLP-PULSE-TX 15%-85% rise time and fall time 30%-85% rise time and fall time Pulse width First LP exclusive-OR clock pulse of the LP after Stop state or last pulse exclusive-OR before Stop state clock All other pulses Period of the LP exclusive-OR clock Slew rate @ CLOAD = 70pF Slew rate @ CLOAD = 0 to 70pF (Rising Edge Only) Slew rate @ CLOAD = 0 to 70pF (Rising Edge Only) Load capacitance TLP-PER-TX V/tSR CLOAD Table 29: Min Nom Max Units 25 35 ns ns ns 40 20 90 150 30 30 - 0.075 * (VO,INST-700) 0 70 ns ns mV/ns mV/ns mV/ns pF Clock Signal Specification Symbol Parameter UIINST UI instantaneous PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN Min 60 Typ Max Units 12.5 ns (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Table 30: Data-Clock Timing Specifications Symbol Parameter Min TSKEW Data to Clock Skew (measured at transmitter) -0.15 PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN 61 Typ Max Units 0.15 UIINST (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Package Dimensions Table 31: Package Dimensions Nominal Min Max Nominal Max Parameter Symbol Package Body Dimension X Package Body Dimension Y Package Height Cavity height (glass to pixel distance) Glass Thickness Package Body Thickness Ball Height Ball Diameter Total Ball Count Ball Count X axis Ball Count Yaxis UBM Pins Pitch X axis Pins Pitch Y axis BGA ball center to package center offset in X-direction BGA ball center to package center offset in Y-direction Edge to Ball Center Distance along X Edge to Ball Center Distance along Y A B C C4 C3 C2 C1 D N N1 N2 U J1 J2 X 4.64815 3.84775 0.690 0.041 0.400 0.570 0.120 0.230 55 8 7 0.240 0.520 0.520 0 4.62315 3.82275 0.645 0.037 0.390 0.535 0.100 0.200 4.67315 3.87275 0.735 0.045 0.410 0.605 0.140 0.260 0.18300 0.15149 0.02717 0.00161 0.01575 0.02244 0.00472 0.0090 0.18201 0.15050 0.02539 0.00146 0.01535 0.02106 0.00394 0.00787 0.18398 0.15247 0.02894 0.00177 0.01614 0.02382 0.00551 0.01023 0.230 0.510 0.510 -0.025 0.250 0.530 0.530 0.025 0.009449 0.020472 0.020472 0 0.00906 0.02008 0.02008 -0.00098 0.00984 0.02087 0.02087 0.00098 Y 0 -0.025 0.025 0 -0.00098 0.00098 S1 S2 0.504 0.364 0.474 0.334 0.534 0.394 0.01985 0.01433 0.01866 0.01314 0.02103 0.01551 Note: PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN Millimeters Min Inches Package center = die center. 62 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Figure 38: Package Mechanical Drawing First Active Pixel A 1 2 3 4 5 6 7 J1 8 8 7 6 5 4 3 2 S1 1 A J2 A B J1 D Die center (0m, 0m) E F D X E F D Note: The orientation of the figure is with the lens. J2 C Y C B B Optical center (0.1m, 87.195m) S2 G G Top View C C2 C3 C4 C1 Bottom View Cross-section View (E - E) Table 32: Ball Matrix 1 2 3 4 5 6 7 8 A VAA Reserved1 DOUT[6] DOUT[4] DOUT[2] VDD DOUT[1] VDD B GND VAA VDD_IO DOUT[5] DOUT[3] GND DOUT[0] VDD_IO C VDD OE_BAR AGND GND VDD_IO FV LV DOUT[7] Reserved1 DOUT_LSB1 GND VDD D CONFIG SCLK SDATA 1 E VDD_IO CHAIN Reserved SADDR RESET_ BAR DOUT_LSB0 GND VDD_PHY F EXTCLK PIXCLK GND TRST_BAR DATA_N DATA_P CLK_P CLK_N G VDD FLASH VDD PGND2 PGND2 VDD_PLL GND_PLL GND_PLL Notes: PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN 1. Do not use. 2. To be used for EMI shielding. 63 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor Revision History Rev. E . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4/13/11 * Corrected typo in Table 31, "Package Dimensions," on page 62 (changed Ball Diameter nominal, millimeters to 0.230) Rev. D . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3/11/11 * Updated to Production * Updated Figure 2: "Typical Configuration," on page 8 and added note 9 * Updated Table 3, "Pin Descriptions," on page 9 * Updated Table 4, "Power-Up and Power-Down Signal Timing," on page 11 * Updated "Serial Port" on page 17 * Added 3rd paragraph to "Two-Wire Serial Interface" on page 47 * Added "Patch RAM" on page 51 * Updated Table 22, "Standby Current Consumption (Parallel and MIPI)," on page 57 * Updated Table 25, "MIPI High-Speed Transmitter DC Specifications," on page 60 * Updated Table 26, "MIPI High-Speed Transmitter AC Specifications," on page 60 * Updated Table 27, "MIPI Low-Power Transmitter DC Characteristics," on page 60 * Updated Table 28, "MIPI Low-Power Transmitter AC Characteristics," on page 60 * Added Table 29, "Clock Signal Specification," on page 60 * Added Table 30, "Data-Clock Timing Specifications," on page 61 * Updated Table 31, "Package Dimensions," on page 62 Rev. C . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .12/16/10 * Applied new Aptina template * Updated Table 1, "Key Parameters," on page 1 * Updated Table 2, "Available Part Numbers," on page 1 * Updated Figure 4: "Power-Up and Power-Down Sequence," on page 11 * Updated Table 4, "Power-Up and Power-Down Signal Timing," on page 11 * Updated Table 5, "Status of Output Signals During Hard Reset, Soft Standby, and Power Off," on page 12 * Updated "Uncompressed Raw Bayer Bypass Output" on page 42 * Updated "UVC Interface" on page 43 * Updated Table 21, "Operating Current Consumption," on page 56 * Updated Table 22, "Standby Current Consumption (Parallel and MIPI)," on page 57 * Updated Table 23, "AC Electrical Characteristics," on page 58 * Updated Figure 36: "Parallel Pixel Bus Timing Diagram," on page 58 * Updated Table 31, "Package Dimensions," on page 62 Rev. B, Preliminary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9/9/10 * Added Figure 35: "Typical Quantum Efficiency," on page 53 * Removed Exposure Control section * Updated"Auto Exposure" on page 37 * Removed old Figure 20 * Updated Figure 13: "Three Rows in Normal and Row Mirror Readout Mode," on page 21 * Add Figure 35: "Typical Quantum Efficiency," on page 53 * Updated Table , "," on page 60 * Updated Table 23, "AC Electrical Characteristics," on page 58 PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN 64 (c)2009 Aptina Imaging Corporation. All rights reserved. Aptina Confidential and Proprietary MT9M114: 1/6-Inch 720p High-Definition (HD) System-On-A-Chip (SOC) Digital Image Sensor * * * * * * * * * * * * * * * * * * * * * * Updated Figure 2: "Typical Configuration," on page 8 Updated Table 25, "MIPI High-Speed Transmitter DC Characteristics," on page 60 Updated Table 23, "AC Electrical Characteristics," on page 58 Added Table 24, "Standby Current Consumption (Parallel and MIPI)," on page 69 Replaced Table 21, "Operating Current Consumption," on page 56 Updated Table 20, "DC Electrical Characteristics," on page 55 Added section "Soft Standby Mode" on page 14 Updated Table 6, "Hard Reset," on page 13 and Table 7, "Soft Reset Signal Timing," on page 14 Added CSP information Updated Table 1, "Key Parameters," on page 1 Updated Table 2, "Available Part Numbers," on page 1 Updated Table 6, "Hard Reset," on page 13 notes Updated "Soft Reset" on page 14 Updated Table 7, "Soft Reset Signal Timing," on page 14 Added "Serial Port" on page 17 Updated "Binning and Summing" on page 25 Added Figure 19: "Pixel Binning and Summing," on page 25 Replaced Figure 24: "Automatic Gamma Curve," on page 31 Removed old figures 26, 27, and 28 Replaced Table 17, "Chief Ray Angle," on page 52 Updated Table 23, "AC Electrical Characteristics," on page 58 Added "Package Dimensions" on page 62 Rev. A . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .9/29/09 * Initial release 10 Eunos Road 8 13-40, Singapore Post Center, Singapore 408600 prodmktg@aptina.com www.aptina.com Aptina, Aptina Imaging, and the Aptina logo are the property of Aptina Imaging Corporation All other trademarks are the property of their respective owners. This data sheet contains minimum and maximum limits specified over the power supply and temperature range set forth herein. Although considered final, these specifications are subject to change, as further product development and data characterization sometimes occur. PDF: 6771379575/Source: 2249577560 MT9M114 DS - Rev. E Pub. 4/11 EN 65 . (c)2009 Aptina Imaging Corporation All rights reserved. Mouser Electronics Authorized Distributor Click to View Pricing, Inventory, Delivery & Lifecycle Information: ON Semiconductor: MT9M114EBLSTCZD3