Scraping HWBOT Stats For Our HWBOT Team

[EHWENTERPRISE]

Hey guys, 

New to the forums, but not to HWBOT. A colleague of mine posted on here with respects to getting some help on how to embed some HWBOT team stats on our forum site for our HWBOT team, but it was deleted, possibly because it seemed like spam, my colleague is @A Zayed. 

We had checked into some API documentation that we found, as per the below link.

https://d3vp4utu9lbqmm.cloudfront.net/api/Query_API_1.0.pdf 

However we were having issues on getting any values return when doing the API calls. Is there an updated API or other method we should be using ? 

Please note that we are aware of the easy embed solution as per: https://hwbot.org/embed/loadembed

Unfortunately this does not satisfy the sort of stats we are trying to pull down to our forum.  Ideally we are looking to be able to scrape the stats for the below 

I would be really grateful if someone could point us in the right direction

All The best
Team ExtremeHW

[Leeghoofd]

@TAGG @noizemaker aren't you the creative guys ?

[noizemaker]

plain and simple html scraping works ?
the api is broken/death

in my scraper i just traverse one html with ~5kb once a day, so less then a regular pageload, keep that in mind we dont want to hurt the bot.
would suggest to just scrape the teampage to keep the "load" close as possible, every information should be there.
https://hwbot.org/team/extremehw/

[EHWENTERPRISE]

On 12/8/2022 at 7:55 PM, Leeghoofd said:

@TAGG @noizemaker aren't you the creative guys ?

 

22 hours ago, noizemaker said:

plain and simple html scraping works ?
the api is broken/death

in my scraper i just traverse one html with ~5kb once a day, so less then a regular pageload, keep that in mind we dont want to hurt the bot.
would suggest to just scrape the teampage to keep the "load" close as possible, every information should be there.
https://hwbot.org/team/extremehw/

Thanks guys that is a big help. 

A shame about the API but it takes time to maintain those and I can see why that may have fallen out of favour.  I will speak to my dev with respect to a small HTML scrape to get the information we need for our widget. 

Indeed, all the information for the widget we can get from one page, so this "should" be easier. 

@A Zayed What do you think ? 

 

Thanks all
E