Hacker News .hnnew | past | comments | ask | show | jobs | submitlogin
Show HN: Rubbrband – Evaluating generated images at scale
11 points by jrmylee on July 28, 2023 | hide | past | favorite | 11 comments
Hey HN! We’re the founders of Rubbrband (https://www.rubbrband.com/), a evaluation platform for image generation models like Stable Diffusion. We provide a monitoring application to detect deformed human features in AI generated images at scale. For example, we automatically flag images of people with deformed eyes or hands.

We’ve worked with several companies leveraging generative image models in production, and found that one of the main problems is that it’s hard to filter images for good quality sample at scale. Typically, teams will have to manually look through the images for these samples, which is slow and expensive.

We wanted to build a monitoring solution that lets you to see all of the images you’ve generated, and to automatically be alerted when an image was generated with a deformity.

We’ve started by building evaluators that detects deformities in human features, like face and hands. We’re focused on expanding rapidly into build evaluators for other types of images, like gaming and design assets.

We charge using a storage-based pricing model. Rubbrband costs 5¢ per image to use, with your first 1000 images uploaded free.

We’d love to hear your thoughts and critiques, if you have any feature requests please let us know!



Nice! What kinds of companies are generating enough AI images that they need automated image assessment? Is it only AI companies doing image galleries, or are there some more enterprise style companies


A healthy mix of both at this point, I would say this problem is more of a problem of enterprise since it occurs at scale.


Nice! I’m guessing CPG type companies using it for product photos and such in particular


That astronaut with a coffee cup in space still looks very silly to me, apart from the eyes, just because the cup handle is facing the wrong way while the hand is positioned as if holding it by the handle.


He's also got six fingers on his right hand and his index finger on the left hand is way too long.


Hm that's true.

We're working on ways to evaluate if an image looks "off" - but its a hard problem because a lot of it is subjective


Yeah, I didn't mean that as a criticism, it's probably impossible to account for everything, and what is off in one context might be fine in another. Filtering out images that contain messed up objects and body parts still hugely reduces the amount of images a human has to look at, so that's valuable either way.

I have no clue about SD other than toying with it, so forgive if this is naive, but do you have any plans to maybe feed this back into the generation, e.g. jiggle the the seed or other parameters around a little until no fingers are malformed?


Yeah I think it's a great idea! Right now because the models are so finnicky changing the seed often does lead to an image with desirable qualities(ie: good hands) so this makes sense.

I do think over time the feedback loops will look much different, as the models get more solid.


Is the first image under "realistic hands" intended to have six fingers on one hand?


Yes it is. That caption is indeed confusing - pushed a fix!


That makes more sense now :) Although now all the images in that first row appear distorted to me.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: