Dr. Codd Was Right: Quant's Hubris

Leading an Insurrection is now an Official Act

The world is not linear.
-- Dr. McElhone/1974

Well, I'm going to do it, whether the women like it or not. I'm going to protect them.
-- The Orange Shitgibbon^©anon./2024 [y'all get burkhas]

Scientists aren't vocal enough about science. There are large groups of people who think scientists are all frauds and who don't believe in science, and they're being cultured by some of our far right-wing politicians, religious leaders and community leaders.
-- Drew Weissman/2022

To date, Microsoft is stating that organizations testing In-Memory OLTP have seen transaction speeds improve by up to 30 times compared to past performance, with the best performance gains achieved when the business logic resides in the database and not in the applications.
-- Jonathan Watts/2015 [my emphasis]

I have had to explain and re-explain and re-explain and re-explain, you know, how relational databases work, what is an eigenvector, what is dimensionality reduction.

-- Christopher Wylie/2018

... but Flash-based storage has such a different performance profile from rotating media, that I suspect that it will end up having a large impact on filesystem design. Right now, most filesystems tend to be designed with the latencies of rotating media in mind.

-- Linus Torvalds/2007

I believe quite strongly that, if you think about the issue at the appropriate level of abstraction, you're inexorably led to the position that databases must be relational.

-- Chris Date/2009

Election day's thought

Democracy is the theory that the common people know what they want, and deserve to get it good and hard.
-- H. L. Menken/1915 [~~let's prove him wrong~~ guess not]

See you next week in a brand new show^{©Heckle and Jeckle}

Therefore:

In a time of SSD, multi-core/processor, two terabyte memory and Optane App Direct Mode machines, there is no reason not to build from BCNF data. Time to do what Dr. Codd demonstrated. Technology has finally caught up with the maths.

10 July 2018

Quant's Hubris - part the third

Once again, we find quants being utterly, and arrogantly, innumerate. Here is a piece telling quants how to build a "database". It's not, of course. Just a flat file your Grand Pappy would be happy with. Gad. We're into serious civil regression.

Commandment 1: all your data shall fit into one single dataframe

And it goes on to be worse. Sigh.

Dr. Codd Was Right

Leading an Insurrection is now an Official Act

About

Shameless Plug

Extended Pieces

Good Stuff

Followers

Blog Archive

10 July 2018

Quant's Hubris - part the third

No comments: