I indexed 669 GB of my GoPro videos using my M1 Max computer and local ML models

That's great, I checked your article when it was in front page because someone mentioned my project in the comments.

Good job for the article and the project. That's great, yes local models are getting better and better

That’s good to hear, open source ML models are getting better and better. I did a small experiment to generate a Spotify year in review like video here is a preview video https://github.com/IliasHad/edit-mind/tree/expirement/year-i...

do you use android and ios, or is there another benefit to having personal media with both?

You don't mind Google using your kids to train their models and advertising algorithms?

Years from now they'll be getting "hey look at BIKE BRANDS' NEWEST CHEAP BIKE REMEMBER WHEN YOU USED TO RIDE BIKE BRAND BIKES"

> Aha, it makes total sense. This number sounds much more reasonable than “669 GB”, since the actual total size of processed frames would be like 10-30 GB.

The reason why is “669 GB” is the total raw footage size when I'm doing the video processing, I downscaled each frame to 720p to make the video processing much faster and I don't need full original quality in order to get accurate results (as far as I know and experiment with).

> I’m just curious tho — is there any paying options that can accelerate this kind of process? Just spin up GPU instances?

For now, I found that NVIDIA GPU for example RTX 3060 with 12GB Vram was much faster than my M1 Max. (still working on optimizing for speed and accuracy).

Yes, I didn’t look at it. But does it upload your videos to the cloud or process them locally? And does it allow to provide custom faces data to help labeling faces in your videos ?

I think Adobe premiere pro have it as well but cloud processed

You'll need a lora for this, porn content rejection is heavy. Or you'll need a abliterated model, not sure if vision also works.

You might want to add something like yolo finetune to detect scenes + face recognition too.

Asking the important questions

Why it’s always the same question? Hahah. I posted my project over Reddit and I got the same one hahah

Last time I tried whisper, it hallucinated an elaborate conversation from sounds of slapping and moaning and it took minutes to spit every single line of it.

Not sure if you’re being sarcastic but I think this is an interesting question. Would deep seek be useful here since it is local?

It's also a bit apples (heh) to oranges for a handful of reasons, but most impactful

- "unified" ram makes all the system ram available as VRAM - dedicated ai coaccelerator thingy

Both of these reasons allow the apple silicon chips to crush conventional cpus in these kind of AI model workload stuffs

No idea about what the windows arm stuff is capable of. I know they use Qualcomm snapdragon chips though.

No comparison. M1 Max has 400GB/s RAM bandwidth while Snapdragon X2 Elite, the latest and greatest , has 228GB/s RAM bandwidth.

“Comparable” is maybe true if we are talking about single core performance, but for memory bandwidth, the M1 Max is about 8 times faster. Wider bus, lower latency, not even close.

To your question, I can’t deny or confirm that because I didn’t tried it this project over a Windows machine yet or a machine with this config

Thank you

Yes, and it’ll result in much faster results than the ones that I did with my computer

The link just timed out for me. I'm in Israel, connecting via residential WiFi. All other sites that I regularly use connect just fine.

Fair enough, what would like to see as an example video and I would make it.

For the dog barking videos, those are only the video scenes that I have a dog barking sound in the video.

I'll keep adding more prompts and example videos, keep an eye for that

I was looking for a solution for this issue of running docker containers over MPS and utilizing their GPU power. I think this project will be the solution for it, I’ll try it very soon and add support for it. Thank you, much appreciated

Sure, I'm using (https://huggingface.co/collections/Qwen/qwen25-vl) which can help me understand action like falling down, because I can provide for example 5 frames (down scaled to 720p) to understand what is happening in this part of the video

The title should link to the "full article". I wonder if OP's domain name is banned or something and they're doing this to get around it

I tried to edit it and add Show HN, but it doesn't show the edited version. Thank you!

That's really great, thank you!

Not really. Grab frames, lower res, classify, combine metadata, transcribe the audio, convert those data (text, visual and audio) to embedding, save them over a vector DB and SQL DB. Which helped me to do semantic search, RAG, search using a screenshot of the video to find the exact the moment in the video plus search using an audio file as well. And other features unlocked with vector DB

Thank you, would like to know your use case for this kind of project and which prompt you want to genearte ?

What tool has this "press power to mark chapter" feature?

word "her" in this context gave me heavy feelings, what makes one to pick such a career move...