|
Post by amipal on Oct 5, 2020 13:24:01 GMT
I get the impression that they were using Office'97 for that spreadsheet, which makes it even more staggering.
Someone gone fucked up their ETL processing.
|
|
|
Post by Shenguin on Oct 5, 2020 13:53:39 GMT
I get the impression that they were using Office'97 for that spreadsheet, which makes it even more staggering. Someone gone fucked up their ETL processing. If the ETL process flow does't allow for a manager to print off the data, and then type it into a different programme, then they done gone badly wrong.
|
|
|
Post by Sheep2 on Oct 5, 2020 13:58:33 GMT
You do the management process as late as possible. That way you hopefully have an undamaged set of data to manipulate when the manager's boss is sacked and the manager is asked to present the 'real' data.
|
|
|
Post by Sheep2 on Oct 5, 2020 13:59:44 GMT
Never let anyone look at the underlying data unsupervised. That's just basic.
If they don't have the information then they can't easily challenge your presentation of it.
|
|
|
Post by Sheep2 on Oct 5, 2020 14:00:16 GMT
Not even a co-conspirator.
Especially not a co-conspirator.
|
|
|
Post by BabyfarkmcGeezak on Oct 5, 2020 14:29:09 GMT
Massive work fuck ups?
I accidentally deleted a slide for a big presentation earlier today and only realised during the presentation when I reached where it should have been. I had to stop screen share and then share again once I found the original document with that slide. All in front of the big wigs states-side.
|
|
|
Post by Shenguin on Oct 5, 2020 14:35:47 GMT
Guardian are now reporting that it was importing a .csv file with more than 2^20 rows in it that caused the problem, meaning Excel cut off all rows beyond this. I'll be honest, it's a mistake I have made, but it's very easily spotted and rectified. Fortunately, it's really obvious when you've done this, and even the most basic of checks on the integrity of the data will show a problem, so I can't see it could have led to any major issues. Oh.
Spreadsheets in the news chat is so fucking hot.
|
|
|
Post by Sheep2 on Oct 5, 2020 14:35:56 GMT
Babyfark's bonus
<This slide has intentionally been left blank>
|
|
|
Post by Tuffers on Oct 5, 2020 14:47:21 GMT
Afternoon
Deleted one of the cleaners slides today from his 'presentation'. I say presentation, it was just the colouring book we gave him for Christmas last year. And the only person that dialed in was his mum.
|
|
|
Post by Sheep2 on Oct 5, 2020 14:57:05 GMT
In this case, the Guardian understands, one lab had sent its daily test report to PHE in the form of a CSV file – the simplest possible database format, just a list of values separated by commas. That report was then loaded into Microsoft Excel, and the new tests at the bottom were added to the main database.
But while CSV files can be any size, Microsoft Excel files can only be 1,048,576 rows long. When a CSV file longer than that is opened, the bottom rows get cut off and are no longer displayed. That means that, once the lab had performed more than a million tests, it was only a matter of time before its reports failed to be read by PHE
Why would you resend the full data every time? It's asking for trouble to continually reinput data. At some point someone will duplicate rather than overwriting entries. Surely you would want each daily or weekly batch in its own file to be input as a batch. Whether you are using NHS data staff or Deloitte staff I'd have expected them to know that Excel had data limits.
There are a few basic checks as well. Such as checking today's data is bigger than yesterday's date if you are importing everything. And that the transaction values and last transaction number have changed.
|
|
|
Post by Chumbles on Oct 5, 2020 15:00:35 GMT
The NHS pay peanuts to their IT staff; I am never surprised when they fuck up my prescriptions*, appointments, records ... there's a section on my Patient Access to let you access your own medical reports. Mine has 2 reports covering the time I've been in hospital for ca. 10 months, the Intensive Care Unit 5 times, had 2 dilatations 18 MRI scans, 3 adverse drug reactions (1 of which v v nearly did for me), 2 dilatations, 8 angioplasties, 3 colonoscopies etc etc... Here's one of their data entry staff: *The latest prescription fuck up is courtesy of the pharmacy for once, where for 5 years they've sent my soluble peptic ulcer tablets with the standard repeat prescriptions. I hadn't had them this time; I ring, there's a new partner pharmacist who's just started and she sees it's a batch prescription (6 months supply) and was waiting for me "to call it off." The existing staff have never put the fact that it's not batch, but an auto renew on the system, they simply knew it. What really pisses me off is her implication that it is my fault that I hadn't received it. That I am some doddering old halfwit who has screwed up. As I explained to the new 'girl', a system that requires me to order it from the surgery and then the pharmacy as well is obviously crackpot. And did she suppose that the tablets had mysteriously appeared without this insane, convoluted procedure for five years down to divine intervention? FFS.
|
|
|
Post by lazybones on Oct 5, 2020 15:33:08 GMT
The NHS pay peanuts to their IT staff; I am never surprised when they fuck up my prescriptions*, appointments, records ... there's a section on my Patient Access to let you access your own medical reports. Mine has 2 reports covering the time I've been in hospital for ca. 10 months, the Intensive Care Unit 5 times, had 2 dilatations 18 MRI scans, 3 adverse drug reactions (1 of which v v nearly did for me), 2 dilatations, 8 angioplasties, 3 colonoscopies etc etc... Here's one of their data entry staff: *The latest prescription fuck up is courtesy of the pharmacy for once, where for 5 years they've sent my soluble peptic ulcer tablets with the standard repeat prescriptions. I hadn't had them this time; I ring, there's a new partner pharmacist who's just started and she sees it's a batch prescription (6 months supply) and was waiting for me "to call it off." The existing staff have never put the fact that it's not batch, but an auto renew on the system, they simply knew it. What really pisses me off is her implication that it is my fault that I hadn't received it. That I am some doddering old halfwit who has screwed up. As I explained to the new 'girl', a system that requires me to order it from the surgery and then the pharmacy as well is obviously crackpot. And did she suppose that the tablets had mysteriously appeared without this insane, convoluted procedure for five years down to divine intervention? FFS. Chumbles ...
That gif is nightmarish.
|
|
|
Post by Sheep2 on Oct 5, 2020 15:44:02 GMT
Guardian are now reporting that it was importing a .csv file with more than 2^20 rows in it that caused the problem, meaning Excel cut off all rows beyond this. I'll be honest, it's a mistake I have made, but it's very easily spotted and rectified. Fortunately, it's really obvious when you've done this, and even the most basic of checks on the integrity of the data will show a problem, so I can't see it could have led to any major issues. Oh. Spreadsheets in the news chat is so fucking hot. news.sky.com/story/coronavirus-data-can-save-lives-data-can-cost-lives-and-this-latest-testing-blunder-will-likely-prove-it-12090904Pre 2007 version of Excel. It failed at 2^16 +1 That's at 65,537 not at over a million. £100 billion doesn't buy an up to date version of Office apparently. It's a world beating track and trace system.
|
|
|
Post by Felice Landry on Oct 5, 2020 15:49:39 GMT
I'm about to start re-watching ST:Next Gen, using a list of suggested episodes, starting with "Encounter at Farpoint".
|
|
|
Post by crankcaller on Oct 5, 2020 15:51:49 GMT
Hello. Too busy with work. Absolute murder.
Games. Wee bit of watchdogs 2 last night. Films. Ford v's Ferrari. Not quite finished it.
|
|
|
Post by Chumbles on Oct 5, 2020 15:52:23 GMT
The NHS pay peanuts to their IT staff... Here's one of their data entry staff:(picture removed at the request of lazybones ) ... usual rant... FFS. Chumbles ...
That gif is nightmarish. This one is probably more apposite: On other matters: I wanted to update my Trump Fairy of Doom avatar to be in a stretch limo tapping his Secret Service guys with the wand, but sadly no-one's there yet.
|
|
|
Post by Chumbles on Oct 5, 2020 18:12:39 GMT
Killed it Activia Rhubarb yoghurt, Tomato soup, 2 slices of wholemeal toast and a Saag Aloo
|
|
|
Post by MrTiddles on Oct 5, 2020 19:19:11 GMT
I get the impression that they were using Office'97 for that spreadsheet, which makes it even more staggering. Someone gone fucked up their ETL processing. They were using Office '97 in 2010, so that wouldn't surprise me.
Hullo.
|
|
|
Post by Tuffers on Oct 5, 2020 19:21:20 GMT
Evenin'
I am watching transfer deadline day on sky sports. Is there anything more futile one could do than this? I'm not even enjoying it. It's painful. In the studio at the moment are The Redknapps. Unfortunately, not Louise, but 'arry and Jamie.
Kill me.
|
|
|
Post by Shenguin on Oct 5, 2020 19:59:16 GMT
|
|
|
Post by Tuffers on Oct 5, 2020 20:13:46 GMT
I've turned channel now. I'm watching Nigella Lawson say very specific things intended for me personally whilst making mash potato. Call off the murder.
|
|
|
Post by Sheep2 on Oct 5, 2020 20:57:36 GMT
Too late.
I have banked the cheque.
|
|
|
Post by Chumbles on Oct 5, 2020 23:19:49 GMT
Too late. I have banked the cheque. I got bad news for you Sheep ...
|
|
|
Post by Chumbles on Oct 6, 2020 0:05:48 GMT
I am watching the Dresden Files. Not brilliant, but very likeable. 4*
|
|