Spark jobs

I am looking for a freelancer with expertise in Hadoop, Nifi, Hive, Spark, Python, AWS Services. Expertise in the above is must specially ***Nifi*** You can directly contact me here [Removed by Freelancer.com Admin for offsiting - please see Section 13 of our Terms and Conditions]

I have got a hive code which does some ETL joins on a set of tables and then some statistical analysis like rolling average, cumulative sum and standard deviation on the final table. I would like to convert this code to Pyspark.

We have this project and this data What we need is: 1. Use Spark ML library instead of SKilearn we want to change SKilearn to Spark ML 2. Add Graphs to show the result 3. Add pictures to show the data if that possible 4. Write comments in each line to understand what you have done 5. Make the code simple and use DataFrame and RDD The most important is to make it without SKilearn w...

We need a part time resource to give online Support required for python + Spark to US people on weekdays morning around 90 minutes IST 6 00 am to 8 00 am will provide 20000 per month minimum 4 years of experienced candidate on all the technologies mentioned above only eligible for the bid.

hey all. I have a project which is used by Skilearn and I want u to use spark instead of it! plus I want u to add some graphs and pictures !! and that's all!!

Need support scala ,java and spark

Suppose there are two folders A and B. A folder will be loaded with Employee data files and B folder will be loaded with Department data files. Every minute, the java program should monitor these folders and trigger SparkA(based on folder A) or SparkB(based on folder B) programs(Spark-Submit or equivalent). After successful completion, the java program should move the processed files to a diffe...

You are to implement the codes in the following github [url removed, login to view] You can find details in two readme files. You will use spark 2.2.0 and python 3.5.1 to do this.

I want someone expert with MapReduce to write for me code

I need scala developer with AWS services known person. Project details will be share with freelancer after bid

Need to convert rdbms dataframe to json dataframe based on schema file.

Map Reduce and Spark to produce Inverted Index. More details to be provided.

Explain about project life cycle, documentation, day to day project activities and real time issues faced in the project code(if possible) etc.

Dear, Write a function that takes a list of integers as argument and calculates how you can 'jump' in this list. Take for example the list List(4, 0, 4, 0, 1, 0, 2,1) The integers stand for how many "steps" you can jump forward. The first 4, for example, means you can jump to one of the next 4 elements, that is 0, 4, 0 and 1. If you land on a field that contains 0,...

Hi i have a project for you are you intersted ?

*Brief* Am looking for a laravel developer to use laravel spark 6.0 to add the following functionality: * Register as a Business * A business should be able to choose categories the business belongs to * A registered business should be able to choose locations the business does business in * A registered business should be able to choose a subscription plan * A registered business should b...

we have a jobs running in airflow(sometimes they are unstable). I need to convert any of the jobs from airflow to oozie. we are planning to keep oozie as a backup. we want to do poc on oozie. It's very urgent

I need a project on sentiment analysis for tweets using spark and scala. USE spark streaming to gets live tweets and NLP library for analysis KIBANA for visualization. This is my basic requirement cost may vary depending the way you give me an output. Beyond all this I already have a project with full source code If you make it to work with no errors i will pay the half amount that which is giv...

On a given data set, create a scalable graph using GraphX/networkit and then apply louvain's algorithm to detect communities.

I need you to develop some software for me. I would like this software to be developed using Java and spark.