Smartgambler
Pro-Punter

Go Back   OZmium Sports Betting and Horse Racing Forums > Public Forums > General Topics
User Name
Password
Register FAQ Search Today's Posts Mark all topics as read

To advertise on these
forums, e-mail us.

Reply
 
Thread Tools Search this Thread Display Modes
  #1  
Old 24th September 2020, 03:08 PM
evajb001 evajb001 is offline
Member
 
Join Date: Oct 2009
Posts: 549
Default Greyhound data - the dogs

Hey lads,

I'm hoping someone can help me out here. I'm trying to get some greyhound data from 'the dogs' website. Basically going into a specific dog you can see all its historical runs if you click the 'show more' button.

i.e. check out this dog:
https://www.thedogs.com.au/dogs/87521/super-tie

I'm using some of Shaun's old macro's to bring in the greyhound which works fine however two things:

1) It only shows the last 5 runs, not the full history of runs
2) None of the box image/text comes through which is arguably the most important part.

If anyone could help it would be greatly appreciated, figured i'd take a look at greyhounds as a bit of a side project but obtaining form from various sources is proving rather difficult.

Can discuss more via email or private messages if that helps and then can provide some screenshots of the macro im using and/or whats coming through to excel.

Cheers
Reply With Quote
  #2  
Old 24th September 2020, 04:28 PM
Shaun Shaun is offline
Member
 
Join Date: Jan 1970
Location: Western Australia
Posts: 3,530
Default

I had a bit of a poke around but pretty much came up with what you have, i even tried using google sheets although i am new to that also.

Since the merger of the tab sites and a few bookie revamps the excel just isn't up to the task, i keep saying i have to move full time in to python, i may have no other choice.
__________________
One Drive Chrome browser doesn't work

"If the corporates are treating you poorly , just go elsewhere."
"If they need you , they will soon find out."
"If you need them , you will soon find out."
--moeee
_______________________________________________
Reply With Quote
  #3  
Old 24th September 2020, 10:15 PM
walkermac walkermac is offline
Member
 
Join Date: Nov 2013
Posts: 763
Default

Quick poke:

You can get the remaining races from the dog's history by adding /full-form?page=1&profile=true to the end of the dog's URL (i.e. you get the latest 5 runs from the URL you posted and the prior ones from that page; there may be multiple pages though - not sure how many records it loads per page).

You could get the box stats by scraping the page HTML into a string, discarding everything to the left of 'box history', and then parsing for the data you want. It's always going to be a grid of the same size and, looking at the HTML code, there's various repeating tags and labels (e.g. "box-history__box table__cell--tight") that you can use to chop the string up to get at the figures you need. (if you were talking about the box data in the history: same deal, more or less: search for "rug_" in the areas of the HTML you're interested in)

Last edited by walkermac : 24th September 2020 at 10:18 PM.
Reply With Quote
  #4  
Old 25th September 2020, 07:28 AM
Shaun Shaun is offline
Member
 
Join Date: Jan 1970
Location: Western Australia
Posts: 3,530
Default

Quote:
Originally Posted by walkermac
Quick poke:

You can get the remaining races from the dog's history by adding /full-form?page=1&profile=true to the end of the dog's URL (i.e. you get the latest 5 runs from the URL you posted and the prior ones from that page; there may be multiple pages though - not sure how many records it loads per page).

You could get the box stats by scraping the page HTML into a string, discarding everything to the left of 'box history', and then parsing for the data you want. It's always going to be a grid of the same size and, looking at the HTML code, there's various repeating tags and labels (e.g. "box-history__box table__cell--tight") that you can use to chop the string up to get at the figures you need. (if you were talking about the box data in the history: same deal, more or less: search for "rug_" in the areas of the HTML you're interested in)



Good one, i went back to have a look how i missed that, my html code reading is a bit lame but i can see the address in the button.
__________________
One Drive Chrome browser doesn't work

"If the corporates are treating you poorly , just go elsewhere."
"If they need you , they will soon find out."
"If you need them , you will soon find out."
--moeee
_______________________________________________
Reply With Quote
Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is On
Forum Jump



All times are GMT +10. The time now is 07:12 PM.


Powered by: vBulletin Version 3.0.3
Copyright ©2000 - 2020, Jelsoft Enterprises Ltd.
2008 OZmium Pty. Ltd. All rights reserved . ACN 091184655