Machine Learning with Apache Spark or equivalent

We are looking to develop an Apache Spark or equivalent Pipeline to replace our hosted ML platform, and host the server ourselves. The current hosted platform is doing quite well, with ROC / AUC, Precision, Accuracy, Recall and F1 all above .98 (mostly above .99), but with 300,000+ Production API Transactions, it is getting quite expensive, so we are looking for alternatives.

Our current 3 classification models (in an ensemble configuration) utilize 300 or so features and seem to perform best with decision tree models, but we would like to explore different models to see which perform optimally.

We have a training data set available in a MSSQL that we can give you access to, and we will need to develop a streaming API so we can submit samples for analysis in real-time, then upload the results (along with the extracted features) to a different table in the MSSQL database. Our desktop software first checks the database to see if an identical sample has already been submitted and analyzed, and if it is not in the database, our desktop software submits the features to the hosted ML platform for analysis, then uploads the results and extracted features to the database.

Skills: Artificial Intelligence, Machine Learning, Spark

See more: Big data using Spark n scala, Machine learning using spark... Tableau visualisation, job machine learning sweden, samiksha mishra machine learning, machine learning, best freelance site machine learning, machine learning outsource, machine learning message board, job machine learning, machine learning statistical nlp option, machine learning freelance, machine learning thesis, looking develop website, machine learning mehreen, machine learning companies vancouver, freelance machine learning, machine learning vancouver, freelancer machine learning

About the Employer:
( 39 reviews ) Overland Park, United States

Project ID: #16127212

Awarded to:


Hi, I have experience building machine learning pipelines using the Cloudera Hadoop stack on various platforms including Azure, AWS and on local hardware. I can recreate your ensemble classification model as require More

$600 USD in 10 days
(6 Reviews)

13 freelancers are bidding on average $637 for this job


HI I am experienced ML developer with python,spark, scala skills and developed various ML models in diverse domains like recommendation engine, predicting the sale order probability for courier company and assigning s More

$888 USD in 10 days
(15 Reviews)

Experienced data scientist having worked on structured as well as unstructured data using a variety of Tree based, Linear & NN based models. Would like to understand the requirements in a bit more detail. Looking for More

$550 USD in 10 days
(7 Reviews)

View my last projects based on Data Mining, Machine Learning, Artificial Intelligence, python, java and I can complete your project perfectly. We have 10+ years experience More

$500 USD in 10 days
(8 Reviews)

Hello I am really excited to see this opportunity and I am looking forward to it. I have the required skills, expertise and the kind of experience that you are looking for, especially in doing machine learning on Apac More

$600 USD in 5 days
(6 Reviews)

Hi, I'm saravana from India working as Data scientist worked in Microsoft Azure Machine learning studio -Python and R. Please check out our site- [login to view URL] Library- Tensorflow More

$880 USD in 10 days
(4 Reviews)

As I have quite good experience in handling projects requiring programming, ML skills and have an expertise with "Tensorflow and other libraries", I would loved to do this project Past projects: - Image-Audio-Vid More

$722 USD in 9 days
(2 Reviews)
$1200 USD in 15 days
(1 Review)

A proposal has not yet been provided

$250 USD in 10 days
(0 Reviews)

Bonjour! It is my humble offer to present my services to you for this project. I have passed 15 certifications here (& with 5-star rating) and your project's domain resides in my area of expertise. I have few question More

$555 USD in 10 days
(0 Reviews)

Hello, I work in Big data technologies including Spark, Kafka, Cassandra ELK etc stuffs Can we further talk in details about the requirements? Thanks!

$616 USD in 10 days
(2 Reviews)

Hi There, I have good experience in Spark and found your project interesting. Can we have more discussion on the project ? My contact details: gmail - mohitjain012 @ [login to view URL], skype - mohit12292. Thanks, Mohit More

$250 USD in 10 days
(0 Reviews)
$666 USD in 10 days
(0 Reviews)