Spark jobs

We are seeking a skilled Big Data Engineer to join our team. The ideal candidate will have experience in data analysis, machine learning, modelling, and pipeline warehousing. Knowledge of Hadoop, Spark, Python, Scala, Java, Storm, Kafka, Flint, Kubernetes, and Docker are essential for this project. The expected duration of the project is more than 3 months. If you have a passion for Big Data and are excited about working in a dynamic team environment, we encourage you to apply.

I just had a few questions about my taser module, my friend and i agreed that when we put 9 volt abtteries in ...my friend and i agreed that when we put 9 volt abtteries in series the voltage doubles and so does the current, i original thought the current wouldn't double but they are proportional, but when the batteries are in parrallel the amps double, i have a taser module and when the batteries that supply power to it are in parrallel the spark it makes is way bigger than in series, that is what i am trying to understand, how come when the batteries are in series the spark is smaller if in both series and parrallel the amps double, i also have a tiny transformer that makes sparks that maybe you could explain how to get up and running, I am not sure the components requ...

I am looking to get this done urgently. The task requirements are attached in the PDF (see the link). I want regular updates of the code and how things are going. The freelancer needs to be very skilled at Python (FastAPI, Spark and kafka) The code needs to be clean, designed architecture. if need for example async code validation, if u use fastapi for example, you can use pydantic for example, regarding the reading from into kafka with validation i guess u may use asynio. You might not need it (i'm not sure myself) the theoretical part with diagram its better explanation in the PDF LINK TO THE PDF--->

I am looking to get this done urgently. The task requirements are attached in the PDF (see the link). I want regular updates of the code and how things are going. The freelancer needs to be very skilled at Python (FastAPI, Spark and kafka) The code needs to be clean, designed architecture. if need for example async code validation, if u use fastapi for example, you can use pydantic for example, regarding the reading from into kafka with validation i guess u may use asynio. You might not need it (i'm not sure myself) the theoretical part with diagram its better explanation in the PDF LINK TO THE PDF--->

a simple task of rest api system design and spark with kafka task description attached. data file will be provided

Please take a look at the PDF first. I want this done within one day. I am fine with your budget. Main thing is that the developer needs to be highly communicative and respond quickly. The work needs to look professional!

Please take a look at the PDF first. I want this done within one day. I am fine with your budget. Main thing is that the developer needs to be highly communicative and respond quickly. The work needs to look professional!

Please have a look at the pdf. It should be professional and should be delivered fast

a simple task of rest api system design and spark with kafka task description attached. data file will be provided

a simple task of rest api system design and spark with kafka task description attached. data file will be provided

Need to do a POC for Azure. Will need to deploy three HDInsights cluster that needs to be air gapped (disable internet) and have AD integration and Kerberos authentication setup with no ESP enabled. Once done, will need to test the connection among the different HDInsights to connect to hive and ADLS using Spark. Finally will have to install some softwares as a jar or package with no internet access.

...that involve existing codebases. The project requires basic CRUD operations and knowledge of Laravel eco system (Jetstream, Spark, Cashier). The preferred development timeline is 3-4 weeks. The candidate should be able to work independently and communicate effectively with the team. Our project was developed using Laravel and Tenancy For Laravel () We used the boilerplate () for user registration and user management. For the next step of the project, we will integrate Laravel Jetstream with the boilerplate for a full user authentication experience. After this we will integrate laravel spark for billing. The front in is developed in reactJS experience with reactJS is a plus. We will provide the current code based

I am looking for a freelancer to design and create a series of original t-shirts with a realistic style for unisex wear. The overarching theme will be animals - including ducks, mice, kittens and frogs - I already have multiple design ideas and I am loo...The overarching theme will be animals - including ducks, mice, kittens and frogs - I already have multiple design ideas and I am looking for someone who can bring them to life as creative, original designs that will bring the concept of these animals to life in an interesting and unique way. I am looking for someone with an eye for detail and a knack for producing innovative designs, that will spark interest and help my business gain momentum. I believe that through these designs, I can find a successful outlet for creativity and e...

using SparkSQL to determine key metrics about home sales data. Then you'll use Spark to create temporary views, partition the data, cache and uncache a temporary table, and verify that the table has been uncached.

using SparkSQL to determine key metrics about home sales data. Then you'll use Spark to create temporary views, partition the data, cache and uncache a temporary table, and verify that the table has been uncached.

I am looking for a Laravel developer to help me set up my existing project with customized user authentication functionality. In addition, I require further customization to b...authentication and customization. Payment gateway integration and API development skills are a plus. We will be working with the following technologies. Https:// Https:// Http:// In general we will use Tenancy for Laravel and the boilerplate to integrate billing with Spark and user registration with Jetstream. The goal of the contest is to setup the environment, have a user register, verify email, select a billing plan. We will provide licenses for Laravel stack and ui flow via HTML.

I am looking for a Google Sheets expert who can help me with an App Script that will add a ...running a campaign for a single track but are activating multiple services - here’s how it would impact the campaign code: Sample Entry: Song: Poker Face Artist: Lady Gaga Services: TrueView, In-Feed, TikTok Spark, Meta Out Now TrueView ID: 00001-06-003 In-Feed ID: 00001-06-004 TikTok Spark ID: 00001-05-001 Meta Out Now ID: 00001-01-001 So these are all associated with the same overall marketing campaign (00001), with each different platform having its own codes, and then each service within those platforms also has a unique ID (003 being trueview, 004 being in-feed, and 001 being Spark and Out Now) One-time project with a few tweaks if needed after testing. I app...

We want to stand up a new apparel line targeted at welders, with flame and spark resistance, along with designs that incorporate fits and features that will be appreciated by the trades.

...priority. I can help you for: · Editing · Formatting (Text, numbers, cells) · Complex calculations · Formulas · Any type of functions · Logical functions · Data and time functions · Text functions · Statistical functions · Vlook up, XLookup Factor · Any type of Charts · Formatting of charts · Spark lines · Pivot Table & Pivot charts · Scenario summary · Conditional formatting · Creating Hyperlink/links · Using and calculating data from other sheets · Sorting & filtration · ...

Please Sign Up or Login to see details.

I want to convert streaming data coming from the streaming read it usinf stream method and convert the incoming value whihc is bytearray encripted format to json format using java .

Hi, If you are looking for freelancer, I'm here for waiting for you! Please feel free to connect. About me: - Experienced Java Developer with 5 years of expertise in Spring-boot (Rest, Hibernate, Metrics,..), Java SE Java 8 & 11 (collections, multi threading, reflection, generics, exception handling, streams, OOPS) - Java EE, Wildfly - Expert with 3rd party int...and Google services - Selenium - Random fake data generation - API Testing (Rest, Soap) - Cloud services: AWS (S3, Dynamo DB, Cloud watch events, Lambda, Amazon MQ) and Azure (COSMOS DB ) - 3rd party/functional applications Automation - Notification system (Slack integration, email,..) - ETL testing for various databases, files including flat files, zip files, excel, JSON, XML, PDF using Apache spark, POI, PDF BOX...

I am looking to do a re-branding for my server. Right now I have had the same logo for roughly about five years and it's time for a change. The original was sized to fit perfectly to scale to Discords circular profile, and the new one would also have to be compatible for that as Discord is our main go-to for the community. I have also attached an alternative logo which may spark some creativity in those interested in designing a logo for VRP. The logo must include one of the following sections of text; - VirtualRP - Virtual Roleplay - VRP - Virtual RP I am not picky on which one, the design matters more to me than anything else. Please, do not submit a basic font logo, that will be immediately declined.

The Memoci Collection is not just about fashion; it's about fostering a connection. We want our t-shirts to resonate with you, to ignite a spark of inspiration, and to empower you to embrace your true self. Whether you're donning our signature logo, sporting a captivating graphic print, or expressing your individuality through customization, we strive to create a meaningful connection between you and our garments. We invite you to explore the Memoci Collection's finest t-shirts and become part of our story. Together, let's celebrate craftsmanship, inspiration, and the incredible journey that begins when you slip on one of our extraordinary t-shirts. I want to create a brand and i want to have something special different and beautiful

...content. Key Objectives: *Keyword Research and Optimization: Identify optimal keywords for our niche and ensure they're integrated effectively into our content and tags. *Content Creation: Write engaging, SEO-friendly blog posts and forum topics that align with our platform's focus and audience interests. *Forum Engagement: Populate our forums with thought-provoking questions and responses to spark discussions and engage our community. *Meta Description Optimization: Create compelling, keyword-rich meta descriptions for our site and its various pages. *Backlink Building: Assist in generating quality backlinks to boost our domain authority and improve our search engine ranking. *Content Optimization: Review and optimize our site content for SEO, adhering to best p...

Need an exceptional freelancer with expertise in AWS CloudFormation and Python Boto3 scripting to create a CloudFormation template specifically for an EMR (Elastic MapReduce) cluster and develop a validation script. This project requires strong knowledge of AWS services, proficiency in Python...with Boto3, and the ability to meet a strict 5-day can be changed based on project requirements. Requirements: - Extensive experience in AWS CloudFormation, specifically for EMR clusters - Proficiency in Python scripting with Boto3 - Solid understanding of IAM, S3, and EMR services - Previous experience in creating validation scripts or automated testing scripts - Familiarity with Spark and Adaptive Query Execution (AQE) is highly desirable Will tell exact requirements when we connect

...words. Whether you need captivating blog articles, attention-grabbing website copy, or imaginative social media posts, I can deliver content that resonates with your target audience and drives results. As a freelancer, I offer a unique blend of creativity, versatility, and professionalism. I have a deep understanding of the power of words and know how to use them strategically to evoke emotions, spark curiosity, and inspire action. From brainstorming unique concepts to conducting thorough research, I ensure that every piece of content I create is tailored to your specific needs and goals. I pride myself on my ability to adapt my writing style to various industries and target demographics. Whether you're in the technology sector, the fashion industry, or any other niche, I ...

I am looking for a programmer who can help me with a programming task for my Apache Flink Scala Spark and Druid project. The specific task I need help with is programming new functionality for the project. I prefer that the programmer has experience using Scala. The ideal candidate should have experience in programming and be able to write clear and concise code. The expected outcome of the programming task is to have new functionality added to the project. So we put current project is kafka-. > Storm-> kinetica -> API->client and now the requirement is kafka/solace-. > Flink-> Druid -> API->client

I am looking for a freelancer who can me to run a Spark job on my dataset with and without adaptive query execution and show all features in spark UI in AWS EMR. I have two dataframes on which operations are to be dataset size is medium, ranging from 1GB to 10GB. I have specific requirements for the optimization and configuration of the Spark job, so I am looking for someone with expertise in this area. The output Ideal Skills and Experience: - Experience with Spark jobs and AWS EMR - Familiarity with optimizing and configuring Spark jobs - Ability to work with medium-sized datasets - Knowledge of CSV output format

I am looking for a freelancer who can assist me with a spark job using Adaptive Query Execution using AWS EMR service. I have already set up an AWS EMR cluster for this project. I require assistance with both coding and optimization for this project. My preferred programming language for this project is Python. Ideal skills and experience: - Experience with Spark job and Adaptive Query Execution - Proficiency in Python programming language - Knowledge of AWS EMR service - Ability to optimize the code for better performance - Good communication skills to discuss the project progress and requirements. Csv files dataset larger than 10gb

I am looking for an expert in Java with Spark to support me with a specific project. The ideal candidate should have extensive experience in both Java and Spark technologies. Project details: - The project involves building a distributed system with Spark using Java as the primary language. - The system should be scalable and efficient, capable of handling large amounts of data. - The project will require developing custom algorithms, implementing data processing pipelines, and integrating with external APIs. - The project timeline is 3-4 weeks, and the ideal candidate should be able to commit to this timeframe. Skills required: - Expertise in Java and Spark technologies. - Experience building distributed systems and working with large datasets. - Strong prob...

I'm collecting a team of content writers for websites and blog posts in both languages Arabic and English. Do you think you're creative? considered a Fast learner? have research skills and critical thinking? Fast and dedicated? Ready to complete 1 task before hiring? If you're a good reader then you'll spark in this job... This project is for beginners, mainly native Arabians, but English speakers are welcome to participate. intend to pay $10 per 1000 words. But, there will be lectures and proposed tools to teach you to progress. I'll only consider Catchy proposals, take your time writing yours.

am looking for a freelancer who can assist me with a spark job using Adaptive Query Execution using AWS EMR service. I have already set up an AWS EMR cluster for this project. I require assistance with both coding and optimization for this project. My preferred programming language for this project is Python. Ideal skills and experience: - Experience with Spark job and Adaptive Query Execution and Spark UI - Proficiency in Python programming language - Knowledge of AWS EMR service - Ability to optimize the code for better performance - Good communication skills to discuss the project progress and requirements. Csv files dataset larger than 10gb

Requirements Intuitive understanding of machine learning algorithms, supervised and unsupervised modelling techniques and their performance characteristics. Experience working with forex data sets, or price feeds. Experience with machine learning tools and libraries such as TensorFlow, Scikit-learn, R, Spark, with ML in manufacturing and operations spaces are pluses. In particular, working with extensive and messy manufacturing data set, as well as deploying production ready models to the factory. Experience in Algo trading is an advantage. Project description Spread is the ratio between two price feeds, and prediction of the spread is crucial for pair trading. Prediction of the same can help in identifying the distance of spread to Moving average , 2 standard deviation

...connections to other areas apart from these please contact me as well. I am willing to offer a significant part of my salary for the first 5 months to anyone who successfully manages to get me a contract. I am currently based in Uganda with 4 years of Scala development experience. I am familiar with functional programming with Typelevel libraries such as cats, cats effect, doobie and http4s and spark. Other languages i know include python and JavaScript I am currently working remotely as a Scala technical writer for two major Scala blogs but am looking for full time roles, I am extremely motivated and passionate about the language. I've seen many Europeans, UK and USA citizens get Scala developer jobs with much less qualifications. I am just unfortunately in the wrong par...

I'm looking for an experienced data engineer to help with a project on AWS. The project requires expertise in Kafka, spark, snowflake and Amazon Web Services, and involves the processing of large and complex data sets. I'm expecting a timeline of more than 4 weeks to complete this project. If you're up to the challenge, I would love to hear from you!

I am looking for someone who can optimize the memory usage in my Spark tasks. Currently, I am experiencing general slow performance and I believe this is due to high memory usage. I am using Spark 1.x and need someone with experience in optimizing memory usage in this version. The ideal candidate should have experience with Spark optimization and be familiar with GC overhead and OutOfMemoryExceptions.

Hi i need help with designing a roller banner for my business. We do events so i have 360 photo booth, dry ice machine ,cold spark machines

Hello, I designed a rendering of what I had in mind for my website. I would need it to be designed and applied to a wordpress site The theme/style Im going for is a comic/modern feel I dont like the "box" feel. I like seamless sections and borderless images The fields in my contact ...borderless images The fields in my contact form MUST be added and be functional Aside from working on PC, its a MUST the site is easy to navigate via smartphone. The numbers on my example site are just icons that I used as placeholders. You can add icons or whatever you feel fits and looks best Lastly, For the upper portion, Ill let you add my tables to the best looking format to display Why Mr Spark Solar. One person did them as a basic table as I didnt like it at all. Again, I want...

Hello, I am launching a shopify website in about two weeks (May 16 is target). Updates will need to be delivered by May 6. The website is 98% complete, but there are some minor tweaks that I would like before launch (examples: change custom fonts throughout, change the text on a custom contact form, correct some of the sizing to text on pages to ensure consistency throughout). It is the Spark theme. Lastly, I cannot get the edit code page to load. I'm getting an error message that "hmac validation failed" and cannot figure out how to correct. This would also need to be addressed.

...Evaluate candidates' proficiency in key technologies such as Kafka, Spark, and more. ? Assess candidates' knowledge of data warehousing, ETL processes, data modeling, and data architecture. ? Analyze problem-solving abilities and aptitude for handling complex data engineering challenges. ? Collaborate with our hiring team to understand role requirements and align interview criteria. ? Provide detailed feedback and recommendations on candidates' technical abilities and cultural fit. Required Technical Skills: ✅ Strong proficiency in Apache Kafka and its core concepts, such as producers, consumers, topics, and partitions. ✅ In-depth knowledge of Apache Spark and its various components, including Spark Core, Spark SQL, and Spark Streaming....

I am looking for a creative logo designer to design a logo for my company. I need a logo that is square in size, with classic style font and multiple colors. I expect the project to be completed professionally and efficiently. The outcome should also properly reflect my company brand. The freelancer must have a strong portfolio of logos they have designed in t...project to be completed professionally and efficiently. The outcome should also properly reflect my company brand. The freelancer must have a strong portfolio of logos they have designed in the past to show me, and provide adequate examples on how they plan to carry out my project. The logo should be an eye-catching design that is catchy and memorable, and the colors chosen should be vibrant and spark interest in potential c...

...Funday: Share something fun and light-hearted to end the week on a positive note. 8 Product Highlight: Showcase a product or service that you offer and its benefits. 9 Behind the Scenes: Give a behind-the-scenes look at your business or daily routine. 10 Testimonial Tuesday: Share a customer testimonial or success story. 11 Thoughtful Thursday: Share a thought-provoking question or statement to spark discussion. 12 Freebie Friday: Offer a free resource or discount code for your followers. 13 Staff Spotlight: Highlight a member of your team and their role in your business. 14 FAQ Friday: Answer frequently asked questions from your followers. 15 Inspirational Sunday: Share a message of hope or inspiration for the upcoming week. 16 How-To Tuesday: Share a tutorial or step-by-step gu...

Looking for a serious and professional agent for my books ? and at Ingram spark company

Are you a talented designer that can use either Canva or Adobe? I need a sports PDF created. I have the content, I just need someone with the creative spark to bring it to life.

*****Only Indians**** Position: Spark Developer Type: Remote Screen Sharing Duration: Part-Time Monday to Friday 4hours a day Salary: 60,000 INR per month Start Date: ASAP We are looking for a Spark Developer with experience on Spark Development, Scala/Java development, Spark SQL, Streaming and dataframe/dataset API experience and SQL &NOSQL database integration with Spark. We are looking for someone who can work in the EST time zone connecting via remote i.e zoom, google meet on a daily basis to assist in completing the tasks. Here we will be working via screen share remotely, no environment setup will be shared.

I am looking to complete a Twitter sentiment analysis project on trending stocks in the market. This project requires expertise in Big Data Architecture. This project requires real-time tweets to be fetched based on top trending tweets...(top 10 from NYSE and top 10 NASDAQ) from twitter (using twitter API) . Keep fetching x number of tweets for each stock in very short intervals of time to make the data stream live(continuously). Use kafka for data ingestion. Store the data coming from kafka into Amazon S3/gcloud storage Data From Amazon S3 will go to spark for processing Refer for processing in spark Use Cassandra/MongoDB as output sink for spark Frontend dynamic dashboard visualizing results Host the project on AWS/GCP

i am are looking for a data engineer to assist us with our data processing. The ideal candidate will have experience working with Spark Scala and strong java coding will be able to assist me with my data processing tasks. The ideal candidate will have experience with hadoop ,Spark Scala and strong Java and in putty environment will be able to assist me with my data processing tasks.

Hey, I have an urgent project that requires spark, on big data, do you have time to talk? I am willing to pay extra to get it done today.

Position: Spark Developer Type: Remote Screen Sharing Duration: Part-Time Monday to Friday 4hours a day Salary: 60,000 INR per month Start Date: ASAP We are looking for a Spark Developer with experience on Spark Development, Scala/Java development, Spark SQL, Streaming and dataframe/dataset API experience and SQL &NOSQL database integration with Spark. We are looking for someone who can work in the EST time zone connecting via remote i.e zoom, google meet on a daily basis to assist in completing the tasks. Here we will be working via screen share remotely, no environment setup will be shared.