Jump to content
HWBOT Community Forums

Scraping HWBOT Stats For Our HWBOT Team


Recommended Posts

Hey guys, 

New to the forums, but not to HWBOT. A colleague of mine posted on here with respects to getting some help on how to embed some HWBOT team stats on our forum site for our HWBOT team, but it was deleted, possibly because it seemed like spam, my colleague is @A Zayed

We had checked into some API documentation that we found, as per the below link.

https://d3vp4utu9lbqmm.cloudfront.net/api/Query_API_1.0.pdf 

However we were having issues on getting any values return when doing the API calls. Is there an updated API or other method we should be using ? 

Please note that we are aware of the easy embed solution as per: https://hwbot.org/embed/loadembed

Unfortunately this does not satisfy the sort of stats we are trying to pull down to our forum.  Ideally we are looking to be able to scrape the stats for the below 

image.png.05a95b5ea9c7aa1182b8833b40cc0af4.png

I would be really grateful if someone could point us in the right direction :)

All The best
Team ExtremeHW

Link to comment
Share on other sites

plain and simple html scraping works ?
the api is broken/death

in my scraper i just traverse one html with ~5kb once a day, so less then a regular pageload, keep that in mind :) we dont want to hurt the bot.
would suggest to just scrape the teampage to keep the "load" close as possible, every information should be there.
https://hwbot.org/team/extremehw/

image.thumb.png.7a254c1bfb2fc5a2fa0f56b412d23eea.png

image.thumb.png.2b12c931b6861cba69d01fb3145dcfc5.png

  • Like 2
  • Thanks 1
Link to comment
Share on other sites

On 12/8/2022 at 7:55 PM, Leeghoofd said:

@TAGG @noizemaker aren't you the creative guys ?

 

22 hours ago, noizemaker said:

plain and simple html scraping works ?
the api is broken/death

in my scraper i just traverse one html with ~5kb once a day, so less then a regular pageload, keep that in mind :) we dont want to hurt the bot.
would suggest to just scrape the teampage to keep the "load" close as possible, every information should be there.
https://hwbot.org/team/extremehw/

image.thumb.png.7a254c1bfb2fc5a2fa0f56b412d23eea.png

image.thumb.png.2b12c931b6861cba69d01fb3145dcfc5.png

Thanks guys that is a big help. 

A shame about the API but it takes time to maintain those and I can see why that may have fallen out of favour.  I will speak to my dev with respect to a small HTML scrape to get the information we need for our widget. 

Indeed, all the information for the widget we can get from one page, so this "should" be easier. 

@A Zayed What do you think ? 

 

Thanks all
E

Link to comment
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

×
×
  • Create New...