IMX071 (D5100/D7000) Sensor Protocol

All things embedded.
*NO FEATURE REQUESTS*

Re: IMX071 (D5100/D7000) Sensor Protocol

Postby Fred » Mon Apr 13, 2015 2:05 am

Way to go, Lee!! :-)
Fred
 
Posts: 37
Joined: Mon Jul 28, 2014 5:09 am
Location: Budapest
Been thanked: 5 times

EI-155 VMAX register are 14bit space

Postby astronomer » Fri Apr 24, 2015 9:59 am

This is really weired, the VMAX register on EI-155 is only 14bit space. Maybe it's custom configured chip like FPGA.

VMAX_overflow.jpg


Set VMAX to be 0xEFFF but only 12287 effective lines.
61439 1110111111111111
12287 0010111111111111

Thus lowest FPS is obtained at 0x3FFF or 0.3151 seconds, equivalent to 3.173FPS. You might be able to increase the HMAX in order to further lower the FPS.
But this is not the only limitation.

Investigating further on the sensor side, it seems the SHS1 on IMX071 is using 12bit space instead of 16bit on IMX035 or 17bit space on IMX036. And since the shortest exposure is VMAX - SHS1 lines, the actual VMAX can only go up to 0xFFF if you want to achieve a minimal possible electronic shutter in movie. Otherwise, the shortest exposure will be VMAX - 0xFFF lines.

However if you do not care, then VMAX can go to 0x3FFF to achieve 3FPS. And the sensor can be very sensitive in the dark.
User avatar
astronomer
Developer
 
Posts: 722
Joined: Fri Apr 06, 2012 10:06 am
Location: US
Been thanked: 292 times

Re: IMX071 (D5100/D7000) Sensor Protocol

Postby astronomer » Sat Feb 27, 2016 9:46 pm

OK, as I had promised, I'm back to hardware hacking related to Sony sensors.To start off, I tried to confirm what leegong got from the EI-155 was indeed the raw data from the sensor. So I hooked it up with a powerful oscilloscope, again, with some tricks.

10Bit-mode.png


The data confirms the image sensor does indeed output 10bit data packaged in 14bit DDR transmission. And this is for both normal skipped and zoomed 1:1 readout. Too bad. :handgestures-thumbdown:

As for the size of the image, I could confirm there are 1656 horizontal pixels in the normal liveview. Thus the image sensor already binned pixel horizontally on chip. There's nothing more on EI-155 except to drive the sensor and do deserialization for EXPEED.

Why only 10bit? Probably the answer is power consumption. Running at 12 or 14bit internally will use a lot more power and takes a lot longer, because the column parallel is not doing successive approximation. Instead it ramps up from 0 to the biggest value available one by one. I guess it will be the same for later generation like D800/D600 or even D5300.
User avatar
astronomer
Developer
 
Posts: 722
Joined: Fri Apr 06, 2012 10:06 am
Location: US
Been thanked: 292 times

Re: IMX071 (D5100/D7000) Sensor Protocol

Postby onnevan » Mon Feb 29, 2016 9:41 am

I don't know about D5300 but D5200's image sensor is a Toshiba TOS-5105, so it may be hope for the d5200?
onnevan
 
Posts: 6
Joined: Sun Apr 20, 2014 11:08 am
Been thanked: 0 time

Re: IMX071 (D5100/D7000) Sensor Protocol

Postby Silentg » Tue Mar 08, 2016 6:10 pm

astronomer wrote:OK, as I had promised, I'm back to hardware hacking related to Sony sensors.To start off, I tried to confirm what leegong got from the EI-155 was indeed the raw data from the sensor. So I hooked it up with a powerful oscilloscope, again, with some tricks.

10Bit-mode.png


The data confirms the image sensor does indeed output 10bit data packaged in 14bit DDR transmission. And this is for both normal skipped and zoomed 1:1 readout. Too bad. :handgestures-thumbdown:

As for the size of the image, I could confirm there are 1656 horizontal pixels in the normal liveview. Thus the image sensor already binned pixel horizontally on chip. There's nothing more on EI-155 except to drive the sensor and do deserialization for EXPEED.

Why only 10bit? Probably the answer is power consumption. Running at 12 or 14bit internally will use a lot more power and takes a lot longer, because the column parallel is not doing successive approximation. Instead it ramps up from 0 to the biggest value available one by one. I guess it will be the same for later generation like D800/D600 or even D5300.


Hmm. Isn't standard DSLR video 8-bit? I wonder what kind of improvement we'd get with this extra info. Thanks for the research.
Silentg
 
Posts: 8
Joined: Mon Aug 03, 2015 1:59 pm
Been thanked: 1 time

Re: IMX071 (D5100/D7000) Sensor Protocol

Postby astronomer » Thu Mar 10, 2016 10:36 am

Silentg wrote:
Hmm. Isn't standard DSLR video 8-bit? I wonder what kind of improvement we'd get with this extra info. Thanks for the research.


8bit is debayered, gamma corrected color image. For RAW, you have to have at least 10bit to cope with a shadow lift factor of 4.
User avatar
astronomer
Developer
 
Posts: 722
Joined: Fri Apr 06, 2012 10:06 am
Location: US
Been thanked: 292 times

Re: IMX071 (D5100/D7000) Sensor Protocol

Postby astronomer » Thu Mar 10, 2016 10:44 am

onnevan wrote:I don't know about D5300 but D5200's image sensor is a Toshiba TOS-5105, so it may be hope for the d5200?



No it is a custom made/design and it will be even more difficult to hack it without related information.
User avatar
astronomer
Developer
 
Posts: 722
Joined: Fri Apr 06, 2012 10:06 am
Location: US
Been thanked: 292 times

Re: IMX071 (D5100/D7000) Sensor Protocol

Postby wmx-87 » Thu Jul 28, 2016 1:06 pm

Hello. I'am new on this forum. First of all, great job whit the firmware! I have self modified cooled d5100. I use my camera to astrophotography. I have kept it rgb still, might someday try to remove the micro lenses. And ofcourse i use nikonhackers firmware.

I have been reading this topic couple of times. I have been wondering the iso settings, gain and dynamic range. There must be some optimal iso setting to get full benefict of the camera. I have been reading this all over internet, and been talking whit herra kuulapaa whos in this forum too. He suggest best iso for dynamic range would be somewhere near iso 200-400.

What you think about the best iso?

I use slow optics(f6) and the iso has huge impact on single subs. Not so sure about stacked image. My subs are usually 5-10min long.
wmx-87
 
Posts: 1
Joined: Thu Jul 28, 2016 12:52 pm
Been thanked: 0 time

Re: IMX071 (D5100/D7000) Sensor Protocol

Postby astronomer » Mon Aug 28, 2017 6:11 pm

wmx-87 wrote:What you think about the best iso?

I use slow optics(f6) and the iso has huge impact on single subs. Not so sure about stacked image. My subs are usually 5-10min long.


I typically shoot at ISO320 or ISO400, never higher than that.
User avatar
astronomer
Developer
 
Posts: 722
Joined: Fri Apr 06, 2012 10:06 am
Location: US
Been thanked: 292 times

Re: IMX071 (D5100/D7000) Sensor Protocol

Postby coderat » Tue Nov 28, 2017 10:07 am

From other sources register 0x23 is clipping clamp:
bit 0 offset
bit 1 bk offset
bit 2 opb offset
bit 4 mode

...Unfortunately I get very often broken connection to this site...
Last edited by coderat on Sun Dec 03, 2017 4:49 am, edited 2 times in total.
coderat
Core Developer
 
Posts: 2283
Joined: Fri Apr 26, 2013 10:21 am
Been thanked: 450 times

PreviousNext

Return to Firmware

Who is online

Users browsing this forum: No registered users and 2 guests