Spark Jobs

any spark project in finance domian along with source code and high level diagram

I am looking for a dedicated person who can help me out to write a rapport that is similar to the rapport i have attached. The rapport will be about the use case like what is the purpose of the soring function, what database you have used, and find algorithms to use. You should use Spark, hadoop and MRjob and python programming for Mapping and reducing etc.. The person who gets the job need to ...

will have to develop and maintain our DSL, a dedicated interrogation language. Must be an expert in parser generators, with particular reference to ANTLR and be familiar with java, scale and spark without necessarily being an expert

Develop and validate solution architecture to support business requirements Develop Spark applications to read transaction data and process business rules to report errors and transaction summary Load and transform large sets of structured and semi structured. Read data from Kafka and process data using Spark. Adopt innovative architectural approaches to leverage in-house data integration capabili...

I would like to implement a functionality in my scala and kafka stream application. Every message I receive in kafka has a “id” or “name” key attribute and a “status” in the avro schema. So for every message I receive I would like to check the “status” of each “id” and whenever a “Id” has it’s “status” cha...

I need you to develop some software for me. I would like this software to be developed for Windows using Python.

implement simple algorithm with pyspark

We have an existing pyspark based code (1 to 2 scripts) that runs on AWS glue. We are trying to convert that code into python shell as most of the tasks can be performed on python shell in AWS glue that saves us cost in billing. We have already created some target code but need someone to help fnetune or optimize it. The code is not complicated but we have few internal utility packages and some ...

answer questions in spark using rdd to complete questions

Basically I need to see this as a mock up - [login to view URL] 'Which Matchroom boxer am I?' It runs through these; Callum Smith, Lewis Ritson, Dillian Whyte, Tony Bellew, Scott Quigg, Lawrence Okolie, Murat Gassiev, Luke Campbell, Katie Taylor, Maurice Hooker, Robbie Davies Jr, Demetrius Andrade, Joshua Buatsi, Anthony Fowler Then gets the answer; Kell Brook With this gif above his...

I need a spark AR makeup app demo with custom graphics .

if you have good knowledge in hadoop and pyspark then only bid

I have a task to be complete in Scala Programming, if anyone can help me then it would be great.