Scrape etoro

Closed Posted 3 years ago Paid on delivery
Closed Paid on delivery

Use javascript/ python3 to scrape ALL the customers' investments.

There are some call limits. I am seeking a freelancer to bypass the limit and scrape the full set data.

Mainly 2 apis

1. Scrape all the customer ids

async function get_customers(page){

url = "[login to view URL]"

+ "blocked=false&bonusonly=false&copyblock=false&"

+ `istestaccount=false&optin=true&page=${page}&pagesize=1000&period=TwoMonthsAgo&sort=-copiers`

return fetch(url).then(_ => [login to view URL]()).then(_ => _['Items'].map(_ => _['CustomerId']))

}

2. Scrape their investments

async function scrape_investments(args){

[login to view URL]('scrape')

[login to view URL]('args', args)

[login to view URL](275)

var totalRows = await getTotalRows();

var pages = [login to view URL](totalRows / 1000 + 1) + 1;

[login to view URL]('pages', pages)

var customerIds = [login to view URL];

[login to view URL]('customerIds', customerIds)

var cid_instrumentId_list = [];

var page = 1

for(var customerId of customerIds){

try{

await sleep(1000)

instrumentIds = await getRecords(customerId)

cid_instrumentId_list = [login to view URL]([login to view URL](instrumentId => [customerId, instrumentId]))

[login to view URL]('success')

}catch(err){

[login to view URL]('err')

}

}

[login to view URL]('scrape')

return cid_instrumentId_list

}

JavaScript Python Data Scraping

Project ID: #26842881

About the project

12 proposals Remote project Active 3 years ago

12 freelancers are bidding on average $175 for this job

mehamednews

I’ll develop an automated ✅ web scraping ✅ tool to extract etoro data. Visit my profile where you’d find my previous work in this exact category & client reviews. I can also add additional features to it (If needed): More

$600 USD in 7 days
(19 Reviews)
5.3
velmoorthi

I have an existing code that can collect every customer id.(i implemented multi threading so it can scrap all the customer id easieer) there are around 625 pages has data. If you need please consider my proposal.

$30 USD in 1 day
(25 Reviews)
5.1
plikitik123

hello im a fullstack developer and also a software engineer i have read your description Use javascript/ python3 to scrape ALL the customers' investments. There are some call limits. I am s but i need more detail via c More

$250 USD in 30 days
(15 Reviews)
4.5
Rukki123

Hi, I have Python experience with more than 4 years and written so many scripts using that 1) Web Scraping (Amazon, Facebook, Naukri, etc) using tool (SELENIUM and BEAUTIFUL SOUP)Already scrapped(Amazon, Facebook, Go More

$140 USD in 7 days
(7 Reviews)
3.0
BemaSydykorva

Hi, employer. I want to let you know that I can fulfill your requirements properly as I’ve the experience working in this sector. I’ll able to complete your work in time without making any mistakes. I am eagerly looki More

$50 USD in 2 days
(7 Reviews)
2.7
segunwrites

I am a senior software developer who has carried out many automated tasks related to Crypto-Trading bot, Sports betting bot, Telegram bot, Stock trading bot, Ticketing bot and all other automated bots. Specifically, I More

$140 USD in 7 days
(1 Review)
0.0