To see less ads Register or Login ----- Daily Fantasy Sports games 18+

Side-game data project / FPL data collection

A Forum for all Fantasy PremierLeague.com (FPL) Links, Mini-Leagues and Side Games (i.e. inter-FISO competitions run by FISO users)
Post Reply
User avatar
MoSe
Dumbledore
Posts: 9550
Joined: 10 Sep 2014, 12:25
Location: next door S.Siro stadium
FS Record: FISODAS CUP Winner Season 25
FISO H2H Winner: 15/16 Div2 - 16/17 Div1
FISO Mirror: 16/17 PL Winner

Re: Side-game data project / FPL data collection

Post by MoSe »

Tacalabala wrote: 29 Jul 2017, 08:28
Mav3rick wrote: 29 Jul 2017, 06:52 That particular draft league (1136) has been deleted, you can try this one:i
https://ratemyteam.uk/Fiso/DraftLeague/41257
Oh right so does it only work once the draft has taken place?
Mav3rick wrote: It does yeah, it was just a summary of the result of the draft really.
Probably Taca only needs it to fetch teams data and selections, did you notice anyway my post in the Test Draft topic, showing time calculations need to be amended in the tool?
:)

User avatar
thebillfella
FISO Knight
Posts: 11409
Joined: 07 Dec 2006, 13:24
Location: Republic of Mancunia
FS Record: 6th FPL 19/20; 1st TFF StartXI 14/15; 8th TFFE11; 18th TFFE12; 1st FISO TFFE11&12; 1st FISO Full Draft 12/13,14/15,19/20,20/21; 1st Block14/15; 1st 5ASChampLge 12/13; 1st TFF Super614/15; 1st Spring17; 1st FISO Div Premx6, Cup, Mirror,Prem&H2H Champ 19/20

Re: Side-game data project / FPL data collection

Post by thebillfella »

Mick MacPaddywack wrote:
thebillfella wrote: 24 Jul 2017, 15:22 Does anybody have an updated player list for this season that they could send me please? Having trouble getting it on my phone on hols!

Unfortunately I created an *.xls for you this morning but was unable to attach it. Kinda strange, but it said "invalid file extension".
Tried a *.txt file with the same data & failed to attach again. "invalid file extension". So how do you add files?

You might see if this link works.
Thanks Mick

Much appreciated.


rohitpotter
Kevin and Perry
Posts: 20
Joined: 17 Jul 2017, 21:51
FS Record: https://fantasy.premierleague.com/a/entry/698/history

Re: Side-game data project / FPL data collection

Post by rohitpotter »

@Maverick the grid and league links dont seem to be working... Any idea on whats wrong?

User avatar
MoSe
Dumbledore
Posts: 9550
Joined: 10 Sep 2014, 12:25
Location: next door S.Siro stadium
FS Record: FISODAS CUP Winner Season 25
FISO H2H Winner: 15/16 Div2 - 16/17 Div1
FISO Mirror: 16/17 PL Winner

Re: Side-game data project / FPL data collection

Post by MoSe »

having waited till monday morning,
I confirm the tools all return an error
tested the GRID even with just one ID (mine)
tested a small League of just 3 teams 3688

hopefully it's just the certificate issue again, and not some change by FPL :?

although, I used the league tool last week, and it worked
we use it to have team IDs before season start, in the 5AS H2H Declaration topic viewtopic.php?f=82&t=125137
and they were ok before the deadline

Divisionals will start in GW4... but I figure Taca would have to update Cup results manually?
crossing-fingers...

User avatar
kidzio
Wideboy
Posts: 53
Joined: 06 Sep 2015, 14:42

Re: Side-game data project / FPL data collection

Post by kidzio »

MoSe wrote: 14 Aug 2017, 10:18 having waited till monday morning,
I confirm the tools all return an error
tested the GRID even with just one ID (mine)
tested a small League of just 3 teams 3688

hopefully it's just the certificate issue again, and not some change by FPL :?

although, I used the league tool last week, and it worked
we use it to have team IDs before season start, in the 5AS H2H Declaration topic viewtopic.php?f=82&t=125137
and they were ok before the deadline

Divisionals will start in GW4... but I figure Taca would have to update Cup results manually?
crossing-fingers...
It is indeed not working now. It was still working about 10hrs ago as I managed to use it at that time. Hope it will be back up soon.

User avatar
Mav3rick
FISO Jedi Knight
Posts: 20858
Joined: 20 Jul 2009, 20:35
FS Record: FPL: 1082, 1201, 1800, 10203

The stats are dark and full of errors.

Re: Side-game data project / FPL data collection

Post by Mav3rick »

Try it now guys, there was a bit of an issue with the way I was parsing the live GW data.

This is working now:
https://ratemyteam.uk/Fiso/SideGameData/3052/1

As is the GRID version:
https://ratemyteam.uk/Fiso/GRID/3052

User avatar
Tacalabala
FISO Knight
Posts: 19010
Joined: 07 Sep 2008, 01:03

Re: Side-game data project / FPL data collection

Post by Tacalabala »

Like a dream, cheers Mav!

User avatar
kidzio
Wideboy
Posts: 53
Joined: 06 Sep 2015, 14:42

Re: Side-game data project / FPL data collection

Post by kidzio »

Mav3rick wrote: 14 Aug 2017, 20:11 Try it now guys, there was a bit of an issue with the way I was parsing the live GW data.

This is working now:
https://ratemyteam.uk/Fiso/SideGameData/3052/1

As is the GRID version:
https://ratemyteam.uk/Fiso/GRID/3052
I can't say thank you enough. Thank you Mav! But the manager's names are not showing up in the league version. Will it be showing in the future?

User avatar
MoSe
Dumbledore
Posts: 9550
Joined: 10 Sep 2014, 12:25
Location: next door S.Siro stadium
FS Record: FISODAS CUP Winner Season 25
FISO H2H Winner: 15/16 Div2 - 16/17 Div1
FISO Mirror: 16/17 PL Winner

Re: Side-game data project / FPL data collection

Post by MoSe »

If that was done out of privacy considerations, I have to point out that they're visible anyway in the fpl league itself,
and that with some teams named the same way, manager names are sometimes useful to tell one team from the other.
I observe they're still visible in the pending entrants section at the bottom.
So maybe it's a table output formatting issue?

User avatar
kidzio
Wideboy
Posts: 53
Joined: 06 Sep 2015, 14:42

Re: Side-game data project / FPL data collection

Post by kidzio »

I am not sure if it is out of privacy considerations but I guess it is not. I think it could be just the way Mav had set it to parse the data. The bad news is both the league sidegame and the GRID are down again at the moment. :(

User avatar
Mav3rick
FISO Jedi Knight
Posts: 20858
Joined: 20 Jul 2009, 20:35
FS Record: FPL: 1082, 1201, 1800, 10203

The stats are dark and full of errors.

Re: Side-game data project / FPL data collection

Post by Mav3rick »

They shouldn't be down, working at the moment and I've made no changes :)

The manager name thing is probably just a small thing they have changed, maybe the name of the field has changed in their data.

It's not a privacy thing as the data is all public anyway. I'll fix it at the weekend.

User avatar
kidzio
Wideboy
Posts: 53
Joined: 06 Sep 2015, 14:42

Re: Side-game data project / FPL data collection

Post by kidzio »

Thanks Mav :) That's strange. It is working now. When I tried to use it earlier today, it was down. That's why I posted that message. Once again, really appreciate your work for this :)


Sent from my iPhone using Tapatalk

User avatar
FPLCasual
Kevin and Perry
Posts: 19
Joined: 21 Feb 2016, 01:37

Re: Side-game data project / FPL data collection

Post by FPLCasual »

Hi Maverick,

Any chance you can get "free hit" chip noticed like WC etc?

https://ratemyteam.uk/Fiso/SideGameData/169469/2

https://fantasy.premierleague.com/a/tea ... 17/event/2

Cheers.

User avatar
kidzio
Wideboy
Posts: 53
Joined: 06 Sep 2015, 14:42

Re: Side-game data project / FPL data collection

Post by kidzio »

I think the FPL website changed their json stuff again. The GRID and the SideGameData are not working at the moment. I wish the FPL site would stop making these changes... Hopefully Mav can solve it.

rohitpotter
Kevin and Perry
Posts: 20
Joined: 17 Jul 2017, 21:51
FS Record: https://fantasy.premierleague.com/a/entry/698/history

Re: Side-game data project / FPL data collection

Post by rohitpotter »

Mav3rick wrote: 16 Aug 2017, 12:42 They shouldn't be down, working at the moment and I've made no changes :)

The manager name thing is probably just a small thing they have changed, maybe the name of the field has changed in their data.

It's not a privacy thing as the data is all public anyway. I'll fix it at the weekend.

Hey Mav,

The Grid and League link is not working. Please look into it when you get some time. :)

User avatar
MoSe
Dumbledore
Posts: 9550
Joined: 10 Sep 2014, 12:25
Location: next door S.Siro stadium
FS Record: FISODAS CUP Winner Season 25
FISO H2H Winner: 15/16 Div2 - 16/17 Div1
FISO Mirror: 16/17 PL Winner

Re: Side-game data project / FPL data collection

Post by MoSe »

posted in nickchild's script topic
zomri wrote: 09 Sep 2017, 19:33they have changed their API handles in a way that fixing it should take some time.

User avatar
Tacalabala
FISO Knight
Posts: 19010
Joined: 07 Sep 2008, 01:03

Re: Side-game data project / FPL data collection

Post by Tacalabala »

It's loading for me this morning, but I think there might be some sort of parsing issue - check out GW3 score for 344008

137,184,205,571,698,740,892,1126,1169,1175,1398,1405,1487,1714,1780,1834,1840,2094,2302,2348,2374,2554,4027,4084,4111,4288,4345,4385,4416,4423,5057,5566,5650,7055,7750,8134,8661,8835,9132,10578,10688,10745,12005,13089,13848,14869,15095,26342,29703,30961,41009,42534,44871,48939,50052,51837,52511,58543,58673,73035,73674,83124,85520,86540,101167,111022,111636,119163,121565,124194,130884,139315,142748,155655,166494,170949,174832,175321,232290,236586,254087,258222,276733,316842,320522,327807,336234,338337,343357,344008,367543,382171,395071,421551,423910,537879,612254,620240,631049,683397,704135,719352,731510,736925,741744,749922,815005,926028,932768,968670,1029214,1091161,1107394,1121238,1470954,1810427,2222358

User avatar
kidzio
Wideboy
Posts: 53
Joined: 06 Sep 2015, 14:42

Re: Side-game data project / FPL data collection

Post by kidzio »

Yup. Appears to be working now again. Thanks :) will be using it to update my league tomorrow.


Sent from my iPhone using Tapatalk

User avatar
MoSe
Dumbledore
Posts: 9550
Joined: 10 Sep 2014, 12:25
Location: next door S.Siro stadium
FS Record: FISODAS CUP Winner Season 25
FISO H2H Winner: 15/16 Div2 - 16/17 Div1
FISO Mirror: 16/17 PL Winner

Re: Side-game data project / FPL data collection

Post by MoSe »

Tacalabala wrote: 10 Sep 2017, 10:14 It's loading for me this morning, but I think there might be some sort of parsing issue - check out GW3 score for 344008
they look correct now

as noted in the Cup topic for Libero's zero
MoSe wrote: 01 Sep 2017, 09:27 In Taca's defence, it's notorious that the otherwise excellent and indispensable Mav3rick's GRID tool occasionally fetches all zeros for a/some team's gw, even if that's a past gw, even if previously that data got correctly fetched and it wiil be again in the next future (... but not immediate... :? i.e. the next day it will work, but if you repeat the grid 1 minute or 1 hour later, you get the same "wrong zeros" ). I always thought this glitch is FPL fault, not Mav's, but have actually no direct way to trobleshoot it.
was it the same problem?

User avatar
Tacalabala
FISO Knight
Posts: 19010
Joined: 07 Sep 2008, 01:03

Re: Side-game data project / FPL data collection

Post by Tacalabala »

Yeah that's it, really strange as it was perfect last season. Will have a try tomorrow when the GW is over.

User avatar
MoSe
Dumbledore
Posts: 9550
Joined: 10 Sep 2014, 12:25
Location: next door S.Siro stadium
FS Record: FISODAS CUP Winner Season 25
FISO H2H Winner: 15/16 Div2 - 16/17 Div1
FISO Mirror: 16/17 PL Winner

Re: Side-game data project / FPL data collection

Post by MoSe »

No, it happened several times to me last season, and to andybarrell too
say, once every 2 or 3 gw

maybe you don't use past GW data and you were never hit on the current GW
while in Divisionals I keep formulas on for up to 5 past gws to be shown in the round summary, too much hassle saving just numbers and then reinstating formulas every round.
I overwrite the whole GRID every GW, and there were more chances for it to show, or for you to notice it, as opposed to copying just the current GW rows.
Also using it for our Fiso H2H Division, and got some zeros once in a while there too

User avatar
kidzio
Wideboy
Posts: 53
Joined: 06 Sep 2015, 14:42

Re: Side-game data project / FPL data collection

Post by kidzio »

Hi MoSe and Taco, it's not that problem. The page can't load up. They were showing error message :)


Sent from my iPhone using Tapatalk

User avatar
MoSe
Dumbledore
Posts: 9550
Joined: 10 Sep 2014, 12:25
Location: next door S.Siro stadium
FS Record: FISODAS CUP Winner Season 25
FISO H2H Winner: 15/16 Div2 - 16/17 Div1
FISO Mirror: 16/17 PL Winner

Re: Side-game data project / FPL data collection

Post by MoSe »

those were two different problems

the error message is obvious, FPL has changed something, Mav needs to burden himself with some maintenance, he gets our eternal gratitude

the zeroes are sneaky, the Grid and/or League tools appear to work, but for one or a few random players, data fetched is all zeros
can't say whether it's because timeouts, or errors in FPL data, or what

odd thing, if you retry shortly after, you get exactly the same zeros
you have to retry after some time, say one hour or a couple, and it gets the correct data (hopefully not losing another player/gw)
luckily, in sidegames where we insert over 100 team IDs, GW with errors are a minority

User avatar
Mav3rick
FISO Jedi Knight
Posts: 20858
Joined: 20 Jul 2009, 20:35
FS Record: FPL: 1082, 1201, 1800, 10203

The stats are dark and full of errors.

Re: Side-game data project / FPL data collection

Post by Mav3rick »

I've moved this thread out of the main forum and into the side games forum, which feels like it's natural home.

There's a shadow topic in place in the main forum so existing contributors can still find it.

User avatar
Mav3rick
FISO Jedi Knight
Posts: 20858
Joined: 20 Jul 2009, 20:35
FS Record: FPL: 1082, 1201, 1800, 10203

The stats are dark and full of errors.

Re: Side-game data project / FPL data collection

Post by Mav3rick »

MoSe wrote: 11 Sep 2017, 13:20 the error message is obvious, FPL has changed something, Mav needs to burden himself with some maintenance, he gets our eternal gratitude
Indeed, FPL had changed some of the URLs for their API. Fortunately the data we're using hadn't changed though.
MoSe wrote: 11 Sep 2017, 13:20 The zeroes are sneaky, the Grid and/or League tools appear to work, but for one or a few random players, data fetched is all zeros
can't say whether it's because timeouts, or errors in FPL data, or what
I'll have a look at this now and see if there's some "re-try" logic I can insert.

User avatar
Tacalabala
FISO Knight
Posts: 19010
Joined: 07 Sep 2008, 01:03

Re: Side-game data project / FPL data collection

Post by Tacalabala »

It did grab everything later in the week, just to confirm.

User avatar
Mav3rick
FISO Jedi Knight
Posts: 20858
Joined: 20 Jul 2009, 20:35
FS Record: FPL: 1082, 1201, 1800, 10203

The stats are dark and full of errors.

Re: Side-game data project / FPL data collection

Post by Mav3rick »

I did upload the "re-try" logic over the weekend, so hopefully that makes a difference to the 0s that MoSe has seen on occasion.

User avatar
MoSe
Dumbledore
Posts: 9550
Joined: 10 Sep 2014, 12:25
Location: next door S.Siro stadium
FS Record: FISODAS CUP Winner Season 25
FISO H2H Winner: 15/16 Div2 - 16/17 Div1
FISO Mirror: 16/17 PL Winner

Re: Side-game data project / FPL data collection

Post by MoSe »

thanks Mav, I had personally experienced only 1 case in previous 4 GWs this season with my grid tool runs,
as I said I took the habit to check the imported data in my xls, so it didn't harm me (andybarrel also posted something similar)
and then we had Libero case in FISO Cup GW3 this season, 1st one Taca ever noticed
will report in case I see it happening again, so let's hope no news good news :)

I'm here to report a different odd glitch tho.
I was about to prepare one of my GW scores scatter graph for the Forum League GW5, from data collected yesterday
so I could easily notice 4 odd spikes in the "R" data (Overall Rank, rightmost column)
I reran https://ratemyteam.uk/Fiso/SideGameData/27051/5 right now, and the same errors are still there

#152 R=393,995 instead of 325,473 in its team https://fantasy.premierleague.com/a/entry/1840/history
#322 R=335,681 instead of 704,449 in its team https://fantasy.premierleague.com/a/ent ... 51/history
#507 R=580,734 instead of 1,095,805 in its team https://fantasy.premierleague.com/a/ent ... 13/history
#921 R=1,768,291 instead of 2,301,095 in its team https://fantasy.premierleague.com/a/entry/698/history

they're sorted correctly, all other data appears to be correct, only their OR is incorrect in the League Tool output :?

not an often used item (e.g. in Divisionals I use it as 3rd tiebreaker, so rarely used that I double-check when needed)
but I thought useful reporting it
it's puzzling to me how a tool can fetch 1160 records correctly, and then in only 4 records 1 item comes up wrong :?
corrupt data and inconsistency by FPL across their several /drf/ resources?
always blame FPL ;)

User avatar
Mav3rick
FISO Jedi Knight
Posts: 20858
Joined: 20 Jul 2009, 20:35
FS Record: FPL: 1082, 1201, 1800, 10203

The stats are dark and full of errors.

Re: Side-game data project / FPL data collection

Post by Mav3rick »

Very puzzling. As you say it's odd that 4 out of 1200 wouldn't work, and obviously there's no difference in the way each individual team is retrieved.

I have seen issues in the past where some properties (such as TV) were reported differently on FPL depending on which screen you looked at, although I'm sure that was in the early days last season after the site changed.

User avatar
Mav3rick
FISO Jedi Knight
Posts: 20858
Joined: 20 Jul 2009, 20:35
FS Record: FPL: 1082, 1201, 1800, 10203

The stats are dark and full of errors.

Re: Side-game data project / FPL data collection

Post by Mav3rick »

For anyone thinking that all this data collection looks really hard (it's not really, you just need a little knowledge) then this article was posted on Reddit.

https://medium.com/towards-data-science ... 2598c4b25e

It's a pretty decent beginners guide, I'm thinking there's a lot of guys in this thread who use Google sheets that might find it useful.

View Latest: 1 Day View Your posts
Post Reply

Return to “FPL Links, Mini-Leagues & Side Games”