Show HN: iPhone app takes simultaneous images from 2 lenses, fuses into 1 photo

293 points - last Saturday at 10:47 PM

Source

Comments

jrflo yesterday at 7:24 PM
To be honest, I wouldn't be surprised if Apple isn't already doing this and just doesn't say so explicitly. There is a crazy amount of image processing going on behind the scenes in each smartphone photo. Would be interesting to compare a photo taken with the native camera app and photosynthesis to compare. I'm assuming your demo images on your site are the raw and processed images from your app that don't go through Apple's "secret sauce" processing pipeline.
billylo yesterday at 10:12 PM
Somewhat related... I made an indie app called TwinCam which combines front-and-back camera images to create a combined selfie. Free. No strings attached. Cheers!

https://apps.apple.com/us/app/twincam/id6448645623 https://play.google.com/store/apps/details?id=org.evergreenl...

anigbrowl yesterday at 5:31 PM
Neat work, but the free tier lets you export 3 images a month and the alternative is a subscription? No thanks.
shaky-carrousel today at 2:05 AM
It would have been nicer if the examples wouldn't have been digitally altered to exaggerate the results. For instance, the center of the third photo has been intentionally blurred in the "standard photo" version.

The fact that they have to resort to manipulation to sell their product tells me that they are not trustworthy and that their product is probably underwhelming.

acomjean yesterday at 6:05 PM
It’s weird, because the center of the image will be more detailed, so how are they dealing with the “grid of pixels” that is on the display. Are they doubling up the wide angle.

“Easy-to-understand framing The brackets over the viewfinder indicate the area covered by the more detailed lens. Frame your subject inside them to capture the best detail.“

Reminds me of the old 3d cameras that took two photos at once through 2 lenses (on film)

https://www.ebay.com/itm/206409326865?chn=ps&_trkparms=ispr%...

p1necone yesterday at 8:45 PM
I just assumed this was what all phones with multiple rear cameras were doing, is it not? What are the multiple cameras for other than that?
trashcan2137 yesterday at 5:21 PM
subscription camera app seems like peak comedy to me
EDEdDNEdDYFaN today at 4:36 AM
I cannot see a meaningful difference at all in any of the example photos, so not really seeing what the point of this is.
swah yesterday at 5:22 PM
If it works, Apple copies it soon enough...
roflmaostc yesterday at 6:17 PM
The principle is similar to foveated imaging [1].

Recently, Samsung introduced the ISOCELL platform which allows to select the area which will be recorded at higher resolution compared to other regions.

There can be all sorts of different applications build around such as extracting higher resolution of text regions, etc [2].

Of course, the lens needs to support this resolution but I think that will be default in the mid-term future.

[1]: https://en.wikipedia.org/wiki/Foveated_imaging

[2]: https://dl.acm.org/doi/10.1145/3799902.3811218

650REDHAIR yesterday at 7:20 PM
Why do i need a subscription for a camera app?
jagged-chisel today at 12:48 AM
Not a fan of “Photosynthesis” on the demo. Sliding between the two, “standard” looks clearer and cleaner.
libertas_quae_s today at 8:33 AM
This is interesting. I'm just curious to know how long will it survive until Apple adds something like that to their software. Do you have a fallback plan for this? But I must say that the idea is quite interesting.
dmd today at 12:35 AM
I'm so confused. Does the dev not know that this is what iPhones do by default?
TeMPOraL today at 8:30 AM
Honestly, I assumed the stock phone apps are doing this by default. It would be stupid not to? It's like a low-hanging fruit present ever since phones started having multiple cameras on the back.

(EDIT: though the only real confirmation of this being done that I have is, Samsung's "Camera Assistant" addon has an option to enable "2x zoom" as separate button, and the description there states explicitly it's a synthetic zoom made from combining the main and telephoto camera.)

(EDIT2: come to think of it, for almost any regular mode, if I use my fingers to block two of the three cameras, the image is unchanged, which empirically proves at least Samsung is not doing this - which again makes me wonder, why not? It's an obvious thing to do.)

On that note, I don't understand why there's no widespread, genai-free apps for "super resolution" aka. take a video (or a burst photo shot) of a stationary thing and use it to reconstruct a single photo with much higher detail level.

For videos I can imagine the reason would be that video compression is literally doing the inverse of that (i.e. the information you'd need to reconstruct a higher-resolution image is exactly the one that the compressor throws away for 90% of the frames), so the algorithm and compressor would cancel out. But that doesn't explain why this doesn't seem to exist for burst photos.

crazygringo yesterday at 8:31 PM
I'm confused. So this is just producing a single photo that is clearer in a middle rectangle and blurrier outside that rectangle?

Of course the extra detail in the middle is nicer, but won't the edge of the "detail rectangle" be extremely obvious and distracting? Like when you zoom into satellite view on Maps and it's clear that there's a blurry area and a sharp area?

I don't understand why you'd ever want these two things combined into a single image. I can understand why you'd want to snap photos with both lenses simultaneously as save them as separate photos, but I don't understand why you'd combine them.

PaulHoule yesterday at 5:36 PM
Left side and the right side look the same to me except some subtle differences in the color of shadows…. And another waitlist? Nein Danke.
a2fz today at 9:26 AM
Woah - Alexandra Palace spotted on the landing page?
cantalopes yesterday at 6:31 PM
I am co fused, 50% of photos look better in standard zoom and 50% of them look better woth photosynthesis. This is like an anti campaign for the app hinting "in the end it doesn't really matter"
copper-float yesterday at 8:07 PM
How can you in good conscience charge a subscription for this? It would be one thing if the app relied on infrastructure, but it's a one and done algorithm that's entirely local on device!

Subscriptions are charged because the developer needs to maintain the upkeep and cost of running the service, but that's not applicable here. It's capable of taking a million photographs fully offline, without any reliance on an online service.

Essentially you're saying your product is so superb that people should pay you indefinitely for the privilege of using it. Even though it costs you nothing to maintain, you somehow need people to perpetually pay you for a local, offline algorithm that you wrote one time. How gross, that's the definition of pointless greed.

Shame on you, honestly. This is exactly what's wrong with modern software nowadays. Just like Adobe and all these other companies, taking advantage of people to milk them dry forever. You'll lease a product, you won't have the right to own anything, and you'll be happy about it.

eigenspace last Saturday at 11:11 PM
Very cool stuff, I've long thought there must be some fancy ways to get extra information for better image resolution by taking advantage of the other cameras.

That said, I must also say that most of the side-by-side comparison photos shown here are somewhat impressive, and in some cases, the photosynthesis one just looks worse to my untrained eye.

_______________

I'll choose to take this as evidence of the fact that you're tacking a very difficult problem, and you're also being honest in your comparisons and not cherry-picking too aggressively.

walrus01 yesterday at 7:24 PM
I think this is actually how oneplus phones have taken 'night' mode photos for a very long time in their default camera app, it takes multiple exposures and uses the movement sensor in the phone to pick several which were taken with the least hand jitter, and then stacks them into the final result.
tambourine_man yesterday at 10:34 PM
Nice idea.

On my phone, at least, I had to pintch-to-zoom to 2-3X to see the difference.

And at that size, the “synthesized” version looks much sharper.

You might need more cropping for the mobile version. At 1X I couldn’t tell them apart.

Haven’t checked the desktop version yet

xiaoyu2006 yesterday at 8:39 PM
How is parallax error solved? The two cameras don't share the same optics center.
magarnicle today at 12:06 AM
I want to know what is possible if there were triple the number of cameras on the back of the phone and every single one fired on every photo. If they all focused at different points, the telephotos zoomed at different lengths etc., maybe throw some infrared cameras on there as well, what would be the results when combined?
levanlevi today at 7:36 AM
you don't need subscription model, just one price for lifetime - that will be fair and convert better.

don't do trials - do refund within 28 days

gurjeet yesterday at 8:56 PM
I believe this is something similar to what Lytro aimed to bring to market.

Lytro, Inc. was an American company founded in 2006 by Ren Ng which developed some of the first commercially available light-field cameras.

https://en.wikipedia.org/wiki/Lytro

swiftcoder yesterday at 7:42 PM
This might be a personal preference thing, but in every single example photo on that page, I significantly prefer the colours in the "standard zoom" version of the photo. I wonder if they can figure out how to do this fusion without losing that beautiful contrast the zoom lens brings to the table?
gepeake yesterday at 5:38 PM
This was actually a purported feature of the Pixel 3 camera. Google said it would be constantly taking photos and the different information captured as your hand moved slightly could be used to create higher information density photos. It didn't work very well at that point but the idea was cool!
hnthrowawayacct yesterday at 5:20 PM
very cool app, a few questions: why does the color "temp" of the image change between traditional iphone photography vs your app? it appears to both warm and cool the images. Also why is the contrast decreased, specifically in the library/book store example?
joe-dakroub yesterday at 5:53 PM
I like the idea of this app and the website is well done. Subscription isn't for me, but for folks who take a lot of photos and need this sort of thing, I can see it. Free tier could offer a few more photos per month.
zellyn yesterday at 6:40 PM
Anyone know if they’re using the native camera resolution for the zoomed part or doing sensor fusion to get better quality than either alone?
sgt today at 6:17 AM
I tried this using TestFlight but I get the distinct feeling that this is (1) vibe coded (and as a consequence, a fair bit of AI slop, you can even tell from the UI) (2) Slow and bloated from the get go - just look at the download size, nearly 170MB (3) Also the results are disappoint to say the least.

So maybe other people find more value in this, but it's off my TestFlight for now.

bigwheels yesterday at 5:28 PM
That demo looks like Minority Report level enhancement. Amazing if it really works, but I'll be damned if I'm paying for a SaaS camera app.
deleted yesterday at 11:54 PM
alansaber yesterday at 5:37 PM
Isn't quite a lot of modern smartphone photography post-processing? Yes camera SAAS is extremely funny but I can kinda see it maybe
biker142541 today at 2:38 AM
Awesome work. Now to bring back the fusing of several images into a true high res pano! Not the garbage native “pano” mode but a true stitched mosaic.
1317 yesterday at 10:40 PM
nicer comparison site: https://slow.pics/c/xpGfe2hK
jnsie yesterday at 7:44 PM
Interesting. I wonder if this could be extended to take MPO 3D photos.
guruthechosen today at 8:48 AM
nice one!
cchance today at 1:00 AM
Sily question... why not all 3
tantalor yesterday at 11:44 PM
Leading with a concert photo example is cringe. Camera phones are a scourge on the concert experience. It should not be encouraged.
guruthechosen today at 8:49 AM
this seems to be legit
iamcoder18 yesterday at 5:26 PM
Anything like this for Android or Pixels?
niek_pas yesterday at 8:54 PM
That is a fantastic name.
iAMkenough yesterday at 7:28 PM
My hesitations on this are it stores data in a proprietary format that I may not be able to export to another common format if the product disappears in a few years.

For something personal like photos and the memories they capture, that's not ideal for me.

While the app is still with us, I'm not sure how much it will cost me to export to my photos to my photo library each month.

BugsJustFindMe yesterday at 6:54 PM
"This site was paused as it reached its usage limits. Please contact the site owner for more information."
lattalayta yesterday at 5:45 PM
Similar idea to the discontinued Light L16 camera https://petapixel.com/2017/12/08/review-light-l16-brilliant-...
LoganDark yesterday at 8:43 PM
This appears to use a naĂŻve masking approach (using ML to find the edges of the mask) which seems to suffer from slight uncorrected differences in lens distortion. There's a fairly obvious feathering around the edges of the detailed area, objects shift quite dramatically, and overall I feel like I'd do a better job of this manually. It is a cool idea, but flawed execution. I would prefer something like using ML to generate a displacement map between the wide angle and the narrow angle parts. That way you can map the higher details down faithfully without having to feather the edges nearly as much or compute any mask. That would also solve parallax which I see also looks unaccounted for.
AtheistOfFail yesterday at 8:32 PM
Weird issue: The iPhone dropdown doesn't include the iPhone XR. It's not like I expect it to work, I'm just curious what the app does.
teaearlgraycold yesterday at 7:42 PM
This whole thing feels wrong. OP should be working for a phone manufacturer, not trying to sell this as a subscription. How much is it worth to be able to squeeze a little more visual clarity out of my phone? Maybe $20 maximum? And I feel like I’m on the generous side of the population here. Most people will say $0. But if you’re inside of Apple and you can tell them you can add an average of $1 of perceived value to each of their millions of phones sold each year they’ll be over the moon and you can get a fat salary.
jrm4 yesterday at 7:33 PM
As an Android guy and not an iPhone, or phone pic guy...

What do the multiple lenses do then, if not this? Like,I presumed that was the point.

Are they LITERALLY just decoration for me to make fun of?

Noaidi yesterday at 7:40 PM
Is it just me or do the original photos look better overall?
VaporJournalAPP today at 12:44 AM
[flagged]
vancekai today at 3:02 AM
[dead]
megraf yesterday at 5:52 PM
[flagged]
EGreg yesterday at 5:38 PM
Not just the app idea … but the WEBSITE — is VERY WELL DONE.

I immediately signed up. (And offered to help bring users to this thing.)