Enhance the "Analyze clip for people"

  • Author
  • Message
Offline

Videoneth

  • Posts: 2381
  • Joined: Fri Nov 13, 2020 11:03 pm
  • Warnings: 1
  • Real Name: Maxwell Allington

Enhance the "Analyze clip for people"

PostTue Dec 22, 2020 7:32 pm

This function could be WAY better, in my opinion.

What I would love to see is markers/timestamps or anything that can help us jump directly to the parts where there are faces (associated to a name).

In a list form or anything that can help us to navigate directly to any recognized person by Resolve (with the timestamp too, if it's a list).

Resolve can already recognize faces, and let us put a name on them. But we still have to search for the parts in those clips.

I think my feature request should be the next step.
Windows 10
v19.1.3
nVidia 3090 - Studio 572.16
Offline

Jim Simon

  • Posts: 34426
  • Joined: Fri Dec 23, 2016 1:47 am

Re: Enhance the "Analyze clip for people"

PostWed Dec 23, 2020 9:29 pm

What if there's more than one face?

What if that face shows up more than once?

What markers/flag colors will be used?
My Biases:

You NEED training.
You NEED a desktop.
You NEED a calibrated (non-computer) display.
Offline

Videoneth

  • Posts: 2381
  • Joined: Fri Nov 13, 2020 11:03 pm
  • Warnings: 1
  • Real Name: Maxwell Allington

Re: Enhance the "Analyze clip for people"

PostThu Dec 24, 2020 12:21 am

Jim Simon wrote:What if there's more than one face?

What if that face shows up more than once?

What markers/flag colors will be used?

Meh, I let the engineers to find a way :D

More seriously,

1.
It should work as it currently works. It shows us all the faces it thinks aren't similar, so we can tag them with different name.

2.
Same as 1, if it recognizes the same face, you should just tag it once so that all faces it thinks are similar would take that tag.

3.
Anything that doesn't resemble to the actual markers. A green rectangle around the face maybe.

But I'm thinking more about having a list, with clickable items to go directly to the timestamp. Markers on the timeline would be too much, in my opinion. It could have a detection threshold option like the scene cut detection so it wouldn't search for all the face on all the frames.

One of the idea is to have markers of people spread out through the video so we can navigate to the interesting parts quickly.

Maybe my feature request is too ambitious ahah.

But what I know for sure is that the actual face detection is not that great, because it misses many faces in my 30-40 mins videos, and show me 2-3 people to tag when there are way more.
Windows 10
v19.1.3
nVidia 3090 - Studio 572.16
Offline

Jim Simon

  • Posts: 34426
  • Joined: Fri Dec 23, 2016 1:47 am

Re: Enhance the "Analyze clip for people"

PostThu Dec 24, 2020 5:55 pm

Maxwellx wrote:Maybe my feature request is too ambitious

That's kind of where my thinking is. I'm seeing the current feature being useful for scripted productions, where the takes aren't terribly long and it's not terribly difficult to jog through the clip.
My Biases:

You NEED training.
You NEED a desktop.
You NEED a calibrated (non-computer) display.
Offline

PDS Newton

  • Posts: 23
  • Joined: Thu Feb 03, 2022 7:21 pm
  • Real Name: Paul Schwartz

Re: Enhance the "Analyze clip for people"

PostThu Feb 03, 2022 9:43 pm

I spent some time trying to use "Analyze clip for people" and have some questions and suggestions.

1. Would be good to have a master trainer video on this. I'm a big fan of the recently posted videos. "Face Detection to Generate People Keywords" in the Reference manual is helpful, but took a while to find and digest. I welcome suggestions for how to use "Analyze clip for people".

2. I suggest on set up the program is defaulted to create the smart bins for people. If you are going to bother to analyze, you likely want them. It took me a while to find how to change that setting.

3. My Smart bins don't get updated as I analyze more clips. This seems to be a glitch and pretty much a show stopper for me on usefulness at this point. Is there a solution?

4. Would be nice to be able to edit names of people in the Smart bin titles rather than just on the people page.

5. I used a moderately complex hierarchy of folders to create bins in my media pool and want to analyze every bin and sub bin. Is there a way to do that all at once?

6. After analyzing a photo, resolve just shows one face as being detected. It would be good to show all detected faces, and to be able to select each and indicate either who it is or "ignore."

7. I can't find a way to zoom the photos to be large enough to see whose face has been detected in some photos. Would be good to be able to enlarge photos/clips to full screen with zoom for this purpose.

Return to DaVinci Resolve Feature Requests

Who is online

Users browsing this forum: No registered users and 27 guests