To see less ads Register or Login ----- Daily Fantasy Sports games 18+

Side-game data project / FPL data collection

A Forum for all Fantasy PremierLeague.com (FPL) Links, Mini-Leagues and Side Games (i.e. inter-FISO competitions run by FISO users)
Post Reply
User avatar
Mav3rick
FISO Jedi Knight
Posts: 20858
Joined: 20 Jul 2009, 20:35
FS Record: FPL: 1082, 1201, 1800, 10203

The stats are dark and full of errors.

Re: Side-game data project / FPL data collection

Post by Mav3rick »

RomynPG wrote: 17 Oct 2019, 18:12 One thought though looking at your ratemyteam pages they have everything I need ... do you have a json rather than html response version.
Yeah you can get the JSON, content negotiation is enabled so you just need to GET whichever URL you're interested in with an Accept: application/json header, here's a working example:

https://apitester.com/shared/checks/1fe ... 2ca608fe1d

User avatar
RomynPG
Dumbledore
Posts: 9639
Joined: 13 Oct 2005, 18:32
FS Record: FPL 134 overall 06/07 ... never close since

Re: Side-game data project / FPL data collection

Post by RomynPG »

Mav3rick wrote: 17 Oct 2019, 18:33
RomynPG wrote: 17 Oct 2019, 18:12 One thought though looking at your ratemyteam pages they have everything I need ... do you have a json rather than html response version.
Yeah you can get the JSON, content negotiation is enabled so you just need to GET whichever URL you're interested in with an Accept: application/json header, here's a working example:

https://apitester.com/shared/checks/1fe ... 2ca608fe1d
That looks great - will allow me to limit the changes I need to make to get going - hopefully I'll be able to fix my side of things to go direct later on.

Cheers 8-)

User avatar
MoSe
Dumbledore
Posts: 9550
Joined: 10 Sep 2014, 12:25
Location: next door S.Siro stadium
FS Record: FISODAS CUP Winner Season 25
FISO H2H Winner: 15/16 Div2 - 16/17 Div1
FISO Mirror: 16/17 PL Winner

Re: Side-game data project / FPL data collection

Post by MoSe »

the League one only lacks OP for the extracted GW
it always did (till last time I checked :innocent: )

unless you were referring to the GRID instead, which has it

User avatar
Mav3rick
FISO Jedi Knight
Posts: 20858
Joined: 20 Jul 2009, 20:35
FS Record: FPL: 1082, 1201, 1800, 10203

The stats are dark and full of errors.

Re: Side-game data project / FPL data collection

Post by Mav3rick »

Just a heads up for those of you who use my website for collecting side game data using either the GRID or the league data pages (e.g. https://ratemyteam.uk/Fiso/SideGameData/174846/1), I have today moved my web hosting to a new, cheaper, provider.

The only major difference is that I will now no longer be using the domain www.ratemyteam.co.uk (only www.ratemyteam.uk - note the lack of the .co), but that shouldn't affect most of you as I've had re-directs on the former domain for a couple of years at least. The SSL certificate has changed but is still valid and the underlying IP will have changed (and is no longer static) if you use that for any reason rather than the domain.

You should not see any difference at all in the functionality, although I note at the moment that the GRID is broken (this is due to FPL not having any GW deadline dates for the remaining GWs and should resolve itself when they appear). If you notice any other issues then let me know, but it should be business as usual.

User avatar
Oxford NZ
Dumbledore
Posts: 6923
Joined: 06 Jan 2017, 03:35
FS Record: They think it's all over!

Re: Side-game data project / FPL data collection

Post by Oxford NZ »

Thanks Mav :) I have not loaded any new data into the divisionals for some time :roll: Looking forward to finishing this season one way or another.

User avatar
Mav3rick
FISO Jedi Knight
Posts: 20858
Joined: 20 Jul 2009, 20:35
FS Record: FPL: 1082, 1201, 1800, 10203

The stats are dark and full of errors.

Re: Side-game data project / FPL data collection

Post by Mav3rick »

Oxford NZ wrote: 29 Apr 2020, 09:12 Thanks Mav :) I have not loaded any new data into the divisionals for some time :roll: Looking forward to finishing this season one way or another.
No worries. I've added some extra code to resolve the issues with the GRID I mentioned above so if the season doesn't complete for any reason then the current GRID values can be used to resolve side games in what ever way the admins see fit.

Example GRID url is:
https://ratemyteam.uk/Fiso/GRID/174846

User avatar
Mav3rick
FISO Jedi Knight
Posts: 20858
Joined: 20 Jul 2009, 20:35
FS Record: FPL: 1082, 1201, 1800, 10203

The stats are dark and full of errors.

Re: Side-game data project / FPL data collection

Post by Mav3rick »

Another change to URLs today (consolidating domain names to save on hosting costs).

The domain name has changed from ratemyteam.uk :arrow: emerald-solutions.co.uk, the format of the paths after that is unchanged. I've added a new homepage as well describing the available URLs and usage:

https://www.emerald-solutions.co.uk

User avatar
blahblah
FISO Viscount
Posts: 108502
Joined: 13 Oct 2005, 18:46
Location: .. he thinks that he knows something which he doesn't, whereas I am quite concious of my ignorance.

Re: Side-game data project / FPL data collection

Post by blahblah »

I don't really use your stuff, but you are a star with what you do 8-) 8-) 8-)

User avatar
Mav3rick
FISO Jedi Knight
Posts: 20858
Joined: 20 Jul 2009, 20:35
FS Record: FPL: 1082, 1201, 1800, 10203

The stats are dark and full of errors.

Re: Side-game data project / FPL data collection

Post by Mav3rick »

blahblah wrote: 18 May 2020, 20:01 I don't really use your stuff, but you are a star with what you do 8-) 8-) 8-)
What, I can't believe that don't you use it :lol:

I insist that you start running a side game for the season restart :lol:

User avatar
blahblah
FISO Viscount
Posts: 108502
Joined: 13 Oct 2005, 18:46
Location: .. he thinks that he knows something which he doesn't, whereas I am quite concious of my ignorance.

Re: Side-game data project / FPL data collection

Post by blahblah »

Mav3rick wrote: 18 May 2020, 20:09
blahblah wrote: 18 May 2020, 20:01 I don't really use your stuff, but you are a star with what you do 8-) 8-) 8-)
What, I can't believe that don't you use it :lol:

I insist that you start running a side game for the season restart :lol:
:lol: :lol: :lol: :lol:

Do you remember AKNel's Higher\Lower? I have been thinking of ressurecting that...

I do miss the kinda jousting re presumptions etc behind stats though. The whole Art vs Science kinda thing, or First Principles of Science :wink:

User avatar
Oxford NZ
Dumbledore
Posts: 6923
Joined: 06 Jan 2017, 03:35
FS Record: They think it's all over!

Re: Side-game data project / FPL data collection

Post by Oxford NZ »

Thanks mav. :) I only just noticed the post re the domain name change and must admit to not following the EPL football progress recently.
I am looking forward to completing the season even though thebillfella has won the FISO divisional championships team of the season there is still promotion and relegation to deal with.

User avatar
Mav3rick
FISO Jedi Knight
Posts: 20858
Joined: 20 Jul 2009, 20:35
FS Record: FPL: 1082, 1201, 1800, 10203

The stats are dark and full of errors.

Re: Side-game data project / FPL data collection

Post by Mav3rick »

Yeah I did try setting up redirects but it's complicated by people who may have SSL links bookmarked. The old domains expire in a month anyway so will stop working full stop then.

For the sake of repeating it, just for anyone reading who missed it, the ratemyteam domain has been replaced by the site below, which has been updated to include a guide to the available URL formats.

https://www.emerald-solutions.co.uk

User avatar
Talkie Toaster
Grumpy Old Man
Posts: 4427
Joined: 11 Jul 2017, 15:43

Re: Side-game data project / FPL data collection

Post by Talkie Toaster »

Thanks Mav, great stuff.

Let's hope there's no reprogramming required when they start the season back up again. :D

User avatar
RomynPG
Dumbledore
Posts: 9639
Joined: 13 Oct 2005, 18:32
FS Record: FPL 134 overall 06/07 ... never close since

Re: Side-game data project / FPL data collection

Post by RomynPG »

Hi Mav

I may have missed this elsewhere so apologies if that is the case.

I use your league pages to get the data I need for the 5AS H2H and old GWs are working fine ie (using Incredibles)
https://www.emerald-solutions.co.uk/Fis ... a/11378/29

but if I go for later than that it's all zeroes ie
https://www.emerald-solutions.co.uk/Fis ... a/11378/30

Do you know if there's a way around this? - I'm looking to pick up GW38 overall points (for H2H rankings for 30+) and then the league pages for the +GWs.

Thanks (& thanks)

User avatar
Mav3rick
FISO Jedi Knight
Posts: 20858
Joined: 20 Jul 2009, 20:35
FS Record: FPL: 1082, 1201, 1800, 10203

The stats are dark and full of errors.

Re: Side-game data project / FPL data collection

Post by Mav3rick »

RomynPG wrote: 15 Jun 2020, 11:28 Do you know if there's a way around this? - I'm looking to pick up GW38 overall points (for H2H rankings for 30+) and then the league pages for the +GWs.
Try it again, it should be working now.

I've added an explanation for getting at the GW30+ and beyond data too, but as you'd probably expect it's basically GW39-GW47.

User avatar
RomynPG
Dumbledore
Posts: 9639
Joined: 13 Oct 2005, 18:32
FS Record: FPL 134 overall 06/07 ... never close since

Re: Side-game data project / FPL data collection

Post by RomynPG »

Thanks Mav - got the data to GW38 and therefore GW30+ starting points - hopefully everything else will be good :D

User avatar
thebillfella
FISO Knight
Posts: 11409
Joined: 07 Dec 2006, 13:24
Location: Republic of Mancunia
FS Record: 6th FPL 19/20; 1st TFF StartXI 14/15; 8th TFFE11; 18th TFFE12; 1st FISO TFFE11&12; 1st FISO Full Draft 12/13,14/15,19/20,20/21; 1st Block14/15; 1st 5ASChampLge 12/13; 1st TFF Super614/15; 1st Spring17; 1st FISO Div Premx6, Cup, Mirror,Prem&H2H Champ 19/20

Re: Side-game data project / FPL data collection

Post by thebillfella »

Mav3rick wrote: 19 May 2020, 14:12 Yeah I did try setting up redirects but it's complicated by people who may have SSL links bookmarked. The old domains expire in a month anyway so will stop working full stop then.

For the sake of repeating it, just for anyone reading who missed it, the ratemyteam domain has been replaced by the site below, which has been updated to include a guide to the available URL formats.

https://www.emerald-solutions.co.uk
Hi Mav

Is this working for the draft side games - can't seem to get it working for this league?

814614-208923

User avatar
Talkie Toaster
Grumpy Old Man
Posts: 4427
Joined: 11 Jul 2017, 15:43

Re: Side-game data project / FPL data collection

Post by Talkie Toaster »


User avatar
thebillfella
FISO Knight
Posts: 11409
Joined: 07 Dec 2006, 13:24
Location: Republic of Mancunia
FS Record: 6th FPL 19/20; 1st TFF StartXI 14/15; 8th TFFE11; 18th TFFE12; 1st FISO TFFE11&12; 1st FISO Full Draft 12/13,14/15,19/20,20/21; 1st Block14/15; 1st 5ASChampLge 12/13; 1st TFF Super614/15; 1st Spring17; 1st FISO Div Premx6, Cup, Mirror,Prem&H2H Champ 19/20

Re: Side-game data project / FPL data collection

Post by thebillfella »

Cheers - not sure if an IE / Edge vs. Chrome thing or just user error but that works now!

User avatar
Smurphy Paw
FISO Knight
Posts: 14501
Joined: 17 Aug 2006, 17:48
FS Record: Mediocre, apparently
13/14: FPL 1792; FIFA 14 Top 700.
17/18: FPL 696th; loads of mini-League wins and side game promotions
18/19 1FC Köln 5AS Champions
#1 Spring Super League regular season 19/20 & 20/21

Re: Side-game data project / FPL data collection

Post by Smurphy Paw »

Taca, if you’re lurking and see this can you PM me? Hope you’re well. SP

User avatar
blahblah
FISO Viscount
Posts: 108502
Joined: 13 Oct 2005, 18:46
Location: .. he thinks that he knows something which he doesn't, whereas I am quite concious of my ignorance.

Re: Side-game data project / FPL data collection

Post by blahblah »

Smurphy's Paw wrote: 31 Jul 2020, 18:33 Taca, if you’re lurking and see this can you PM me? Hope you’re well. SP
No, don't help the cheating bstrd :lol:

User avatar
Smurphy Paw
FISO Knight
Posts: 14501
Joined: 17 Aug 2006, 17:48
FS Record: Mediocre, apparently
13/14: FPL 1792; FIFA 14 Top 700.
17/18: FPL 696th; loads of mini-League wins and side game promotions
18/19 1FC Köln 5AS Champions
#1 Spring Super League regular season 19/20 & 20/21

Re: Side-game data project / FPL data collection

Post by Smurphy Paw »

blahblah wrote: 31 Jul 2020, 18:38
Smurphy's Paw wrote: 31 Jul 2020, 18:33 Taca, if you’re lurking and see this can you PM me? Hope you’re well. SP
No, don't help the cheating bstrd :lol:
:lol: :roll:

User avatar
eagle224
Grumpy Old Man
Posts: 2427
Joined: 10 Nov 2005, 22:14
Location: England
FS Record: Veteran

Re: Side-game data project / FPL data collection

Post by eagle224 »

Does anyone have a copy of the bootstrap-static.json from the API at the end of last season before it all got reset? My hard drive failed and it's one of the few files I've not been able to recover.

User avatar
kidzio
Wideboy
Posts: 53
Joined: 06 Sep 2015, 14:42

Re: Side-game data project / FPL data collection

Post by kidzio »

I'm getting a "500 - Internal server error" on the website. Is it only me?


Sent from my iPhone using Tapatalk

User avatar
Mav3rick
FISO Jedi Knight
Posts: 20858
Joined: 20 Jul 2009, 20:35
FS Record: FPL: 1082, 1201, 1800, 10203

The stats are dark and full of errors.

Re: Side-game data project / FPL data collection

Post by Mav3rick »

I assume you mean my site, I just checked and yeah I see it too. The front page doesn't even connect to FPL so something must be wrong with the host.

I'll have a look at the logs later this evening.

User avatar
andybarrell
Dumbledore
Posts: 8990
Joined: 13 Oct 2005, 18:26
Location: Southend-on-Sea
FS Record: 2013 Licence to Kill Winner
2019 S15 R2 Championship Winner
2020 FISO H2H League 1 Winner
2020 5aSide Champions (Falcons)
Contact:

Re: Side-game data project / FPL data collection

Post by andybarrell »

same for me....hopefully an easy fix

User avatar
kidzio
Wideboy
Posts: 53
Joined: 06 Sep 2015, 14:42

Re: Side-game data project / FPL data collection

Post by kidzio »

Looks like may not be an easy fix as it's not up yet. Just have to wait for Mav to update. His work allowed my leagues to run for many years. Ever grateful for that. Hope it will be up soon.


Sent from my iPhone using Tapatalk

User avatar
Oxford NZ
Dumbledore
Posts: 6923
Joined: 06 Jan 2017, 03:35
FS Record: They think it's all over!

Re: Side-game data project / FPL data collection

Post by Oxford NZ »

kidzio wrote: 20 Sep 2020, 07:08 Looks like may not be an easy fix as it's not up yet. Just have to wait for Mav to update. His work allowed my leagues to run for many years. Ever grateful for that. Hope it will be up soon.


Sent from my iPhone using Tapatalk
PM sent.

User avatar
andybarrell
Dumbledore
Posts: 8990
Joined: 13 Oct 2005, 18:26
Location: Southend-on-Sea
FS Record: 2013 Licence to Kill Winner
2019 S15 R2 Championship Winner
2020 FISO H2H League 1 Winner
2020 5aSide Champions (Falcons)
Contact:

Re: Side-game data project / FPL data collection

Post by andybarrell »

stopped working for me again :(

User avatar
Mav3rick
FISO Jedi Knight
Posts: 20858
Joined: 20 Jul 2009, 20:35
FS Record: FPL: 1082, 1201, 1800, 10203

The stats are dark and full of errors.

Re: Side-game data project / FPL data collection

Post by Mav3rick »

Just a heads-up for the side game runners that my new (admittedly probably too cheap) webhost shut off access to the FPL data collection site today as a result of using too much CPU. They warned me about it a couple of months ago and I made some optimisations, but data scraping FPL is quite resource intensive and I think the host isn't really the type that's suitable for this kind of thing.

I moved it as a cost-saving, from circa £180 a year hosting on a virtual server to a cheap shared hosting account costing about 1/10th the price, we got a year out of them but it looks like I will have to find another host. Moving shouldn't be too big a deal, it's all done with automated web publishing these days so if I can find a suitable provider I should be able to publish the code and re-point the domain pretty quickly.

Bear with me if you can while I sort it out, although if you side game runners have any alternate ways of scraping the data and/or have no further need for my site, now would be a good time to let me know :lol: :lol:

View Latest: 1 Day View Your posts
Post Reply

Return to “FPL Links, Mini-Leagues & Side Games”