Need Help Implementing [login to view URL] on Video Inputs for Machine Learning
$750-1500 USD
Paid on delivery
I'm training a video classification model using TensorFlow and Keras. Currently my data pipeline is a custom generator than reads the raw video file, do some preprocessing and feed the processed data into the model batch by batch. However, this is really slow and not scalable to large datasets.
I'm currently running the model on my university's high performance computing server, which allows me to request up to 28 cpu cores (with up to 128 gb of memory each) and 4 gpu cores per job. However, my custom generator, which processes videos sequentially are not utilizing these resources for speedup and is pretty much stuck at the I/O disk reading and video pre-processing part.
I'm unfamiliar with [login to view URL] pipeline but heard that it can prefetch data. I also heard about parallel processing but I'm unable to implement these by myself. So I'm asking for your help to write a code that can prefetch video data, do parallel processing of my videos and utilize the resources provided so that the speed of the training and prediction can be increased.
I'm going to give you more information in the chat room.
This will be ongoing work if it goes well.
Project ID: #27500724
About the project
16 freelancers are bidding on average $1183 for this job
Hello there, How are you doing? Just saw your project posted. I read the brief details and I felt I could help you with it. Lets start the chat and discuss it in detail. Please check my porfolio: My Portfolio: https:/ More
Hi, there. I am a machine learning engineer with 5+ years of hands-on experience in Tensorflow. Carefully checked your requirements. Hope to work for you with this project. Best regards, Sgadou
Hi, I hope you are doing fine. I have almost 10 years of experience in machine learning algorithms. I can implement various types of artificial intelligence algorithms including yours with Matlab, Python, JAVA, etc. I More
Hello! I have read your project details completely and thoroughly. I am Python and have 10 years experience. Further details will be discuss in the inbox. I am waiting for your message to discuss it. Th More