skysight-inc/HackerNews huggingface dataset:
One challenge is that rejecting, or even detecting that something is wrong is often not a simple decision to make. Parsing a CSV in an invalid encoding will usually produce "valid" but nonsensical output. Determining that that has happened when your destination schema is somewhat freeform can be a challenge.
Not to influence elections.
News media is still the primary way of keeping the populace informed. The populace being informed is essential to them making good decisions when voting, without it democracy becomes a sham.

This means that if being a journalist in news media is not "gainful employment in a stable industry that pays them consistently for their work" then we are going to have some serious problems as a society.
XPO software offers shippers real-time cargo tracking
> Tuples don't really count. For performance computing you really want arrays to have mutable contents.

I don't think performance is the biggest win here, but: q/kdb+ doesn't have mutable arrays -- everything is copy-on-write, and it's a lot faster than Julia. If this hypothetical APLish language is otherwise useful, pulling a similar trick would benefit the rest of the Erlang ecosystem.

> Julia's notation is incredibly math-oriented.

APLs almost universally have better notation though. k/q follows:

f:{1+x} /or even just f:1+ // apl is: {1+⍵}

M:2 2#2 0 0 2f // apl is 2 2⍴2 0 0 2
v:1 2f
M mmu v // k can be M$v; apl is M+.×v

v mmu v // v+.×v
v mmu M mmu v

q is less good with your "subtleties" since it doesn't have rank (unlike other APLish languages), but I'm including it for completeness.

m:enlist 2 1f
m mmu' m
m mmu' M mmu/: m

Another APL would probably be better at those.
It's not a conspiracy theory. Ever since the Internet came into widespread use it's anarchic and free-wheeling style has driven the social engineers mad. The media also hates the Internet with an even more raging passion because they want to control the narrative forever and always. The world is "1984" and/or "Brave New World."

Oh, you and your hateful anti-free market analogies. You want to be safe, but being safe means not being free. Sure there's middle ground, but we just watched a bridge collapse in Miami and that bridge was inspected by government wasn't it? So giving up that freedom gave us nothing but hollow promises. I'm with you, though. I want building codes, just not "Agenda 21."
Really what this comes down to is that the CSV "standard" is in actuality an undocumented standard with one reference implementation - Excel. If it works in Excel, it's valid CSV, if it doesn't, then it's not. It's a sad state of affairs, and probably one reason to avoid working with CSV unless absolutely necessary, but there's no getting around that fact.
If a version control tool, when used correctly, ever barfs on your data, that's too frequently. And I wasn't praising Fossil, just raising my gripe with git.
No, just doing as Deep Throat advised and following the money.
I installed it a couple of weeks ago to see if it might be a fit for a volunteer org I am part of.

It is not difficult to install. What is wrong with Ruby? I like Ruby.

I was underwhelmed with what Diaspora actually is though.
JSON Never Dies – An Efficient, Queryable Binary Encoding
How does that get paid for? In the old days it was governments and universities. I am not sure I want them as a sole gatekeeper to information.
How to make $10,000 monthly selling books using paid ads to attract only buyers
While Trump's team may have paid for the data, Clinton's was GIVEN the data.
More background by the photographer "He left it on the desk surrounded by probably upwards of 100 film and still cameras pointed at the desk from every direction. I do not think that constitutes an invasion of privacy." https://twitter.com/becket/status/983846618263891968
I don't know that their belief is a cultural problem, or at least one that's changeable.

The book "The Design of Everyday Things" has this idea that users of things fall into one of two broad groups:

a) users that want fine control and expertise, and are willing to sacrifice simplicity to get it
b) users that want simplicity, and are willing to sacrifice control to get it

I think that most issues of privacy and security boil down to the simple fact that most people are in group b (really, I think that's true of any issue you care to choose). They don't care, and they won't.

The cultural change that could make a difference is when the more secure, more privacy-positive options are also the easier and simpler choices.
What I'm really curious about is the psychology of people that makes them engage in this whataboutism that's present in almost every post about Facebook and this data issue. By the way, both Equifax (American based) and Experian (Irish) are subject to way more regulation than Facebook, which is currently none AFAIK.

P.S. Though Experian had a minor data breach in 2015 you're most likely referring to the far larger (order magnitude higher) Equifax breach.
I'm not talking about access control to the DB, I'm talking about application users. Say you're writing a CRM, and you want a certain group of salespeople to not be able to view clients from Malta.

In our platform, the CRM manager can create a dynamic rule like:

Role: group1
Record Type: Clients
Rule: Country != 'Malta'

Then our ORM will dynamically apply that to any query that accesses the Clients table when the logged-in user belongs to group1. For example, when the user searches for clients with a certain name, the SQL-equivalent query is:

SELECT * FROM clients WHERE name LIKE '%John%';

But before sending it to the DB, the ORM see that the current user belongs to group1, and so will transform it into:

SELECT * FROM clients WHERE name LIKE '%John%' AND country != 'Malta';
This is just easier to implement line-by-line processing than hacking into JSON parsers for this.
5 ACTIONABLE EVENT PROMOTION TIPS
Here's the kicker: We already have some serious problems as a society. They're just too nuanced and technical for most humans to care.
> Yes, it does work in Excel but it's because of 40 years of various edge case fixes that you just cannot replicate in their entirety in your app.

So given its impossible to compete totally with Excel, how do we decide which of these edge cases are worth our time to implement?
"Our testing shows AV1 surpasses its stated goal of 30% better compression than VP9, and achieves gains of 50.3%, 46.2% and 34.0%, compared to x264 main profile, x264 high profile and libvpx-vp9, respectively.

This sounds like AV1 is actually worse than H.265, at least at low-ish resolutions. Am I misreading these results?

For context, I've moved to using H.265 (via the x265 encoder) for archiving 720p and 1080p video. At least for low bitrates (in the 500-1500 kbit/s range) it gives me over 50% smaller filesizes compared to x264 high profile at roughly the same quality. The encoding speed is much slower, of course, but not by more than 10x on modern CPUs, typically less. I had hoped to move over to some AV1 implementation in a few years, but these results make that look doubtful. Are the supposed advantages of AV1 over H.265 confined to ultra high resolutions and/or high bitrates?

Please note that this is a purely technical question. I don't care about the patent issues and for those that do, they've been covered at length in other comments already.
Why? It's not as though someone goes from no-understanding-whatsoever to complete-mastery.

I remember when I decided to form an LLC the next step was do decide which state to do it in--specifically, whether to do it in Delaware or my home state. Cost and convenience (what this article is about) was a consideration.

Then after I decided to do it in my home state, I needed to decide whether to a) do it myself, b) use an online service, or c) use a local attorney. That meant more reading on that particular question.

And so on...
Why soulless? Your life is what you make it. Build meaning yourself.
If someone managed to make a lot of cash and success adapting LOTR (for a long time thought to be "impossible" to adapt to big screens) someone can equally adapt Foundation, given a bit of space for fixing quirks and changing a few things here and there. Let's remain skeptical, alright, but this is actually pretty awesome news if true and I certainly hope for the best.
There are worker cooperatives in the tech world too: https://github.com/hng/tech-coops
Then why not go after Google?
Equifax
The thing is, a lot (all?) of these assumptions are not part of the CSV standard. Things you view as "garbage" might still be technically valid CSV.
> business people understand what CSV files are

I would very much argue against that supposition!

In fact I think it should be the top item of a list of "falsehood users believe about CSV files"!

I've had people submit an Excel file to a service expecting a CSV, and when being told to convert to CSV instead do so by just renaming the file...

> feel safe using them

This much is true, for certain definitions of "feel safe".

> plus you're not relying on any technology or more complex protocol

This is the key point: they usually have and regularly use software that can handle CSV files (however badly), usually Excel, so don't need to learn a new tool from scratch or, in controlled corporate environments, spend six months filing paperwork and chasing requests to get IT to install an appropriate version of a relevant tool to handle the format.
And Obama’s and Hillary used Facebook directly with the cooperation of Facebook. Cambridge was just a proxy for what Democrat candidates were getting for free. It doesn’t make it right but it’s a false equivalence to condemn Cruz for Cambridge without condemning Facebook itself for the other candidates.
When the Dream of Economic Justice Died
Adblocking is the first line of defense against malware and invasive online tracking.

(By adblocking I don't mean like AdBlock Plus I mean more like uBlock Origin.)
Good for you. You should read this: https://xkcd.com/1053/
I think of this https://www.youtube.com/watch?v=rcx-nf3kH_M
As the article points out, the big first programming languages, FORTRAN, COBOL, LISP, and Algol each had their own way of doing variable assignment. FORTRAN used "=" and Algol used ":=" the other two languages used commands or functions to set or bind the values of variables.

In the mid 60's, when I started programming, most programs had to be keypunched. (There was paper tape entry and Dartmouth's new timesharing system using BASIC, but these weren't in very widespread use.) Until 1964, the keypunch machine in use (IBM 026) had a very limited character set. This is the reason that FORTRAN, COLBOL, and LISP programs were written in upper case. Even the fastest "super" computer of the time, the CDC 6600, was limited to 6-bit characters and didn't have lower case letters.

Naturally, symbols like "←" or "⇐" weren't available, but even the characters ":" and "<" were not on the 026 keypunch keyboard and so ":=" or "<-" were much harder to punch on a card.

These early hardware limitations influenced the design of the early languages, and the early programmers all became accustomed to using "=" (or rarely ":=" or SET) as assignment even though "⇐" might have been more logical. The designers of subsequent programming languages were themselves programmers of earlier languages so most simply continued the tradition.
I watched the NCAA basketball final game and Dropbox ran what had to have amounted to several million dollars worth of ads. There comes a point when in order to drive revenue growth you need not only the businesses who are willing to pay top dollar and the individuals who are easily convinced, but a much larger swath of businesses and individuals. They want any customer with a wallet, and they may want bigger businesses more, but they’ll sell to anyone who will pay.
What makes you think large companies are more capable of developing reliable, secure software?
Pascal got a new name and career as PL/SQL ;)
The I, Robot script started out as something entirely unrelated, and some minor tweaks were made to "Asmovify" it after they got the rights for the I, Robot name.

In all of Asimov's robot short stories (including I, Robot), there was only one instance of a robot that violated the Three Laws. That's far from a common theme...

Yes, there was the 0th Law in Robots and Empire (that later appears in the Foundation prequels), but that is a far more nuanced concept than the ideas in the I, Robot movie, where robots ran around killing and injuring humans indiscriminately.
How we initiate point of sale transactions globally
Why not create a transformation function which uses some heuristics to take a non-compliant sort-of-CSV and turn it into a CSV.

Doing so doesn't mean that it is CSV, it just means you can parse it.
> Let's not forget that these are industry-wide practices and that the hearings have less to do with protecting users than it is political grand standing.

One of the themes of the hearing was that these industry wide practices have gone on too long without governmental oversight.
>There are so many companies that collect and sell data on Americans that I don't understand why our Congress is grandstanding on Facebook. Hello credit card companies?

Maybe it is time for you to also get privacy laws where my data is mine and don't belong to the company that store it for me. You can use the data for what you need it to, but should not be allowed to sell or give it to any 3rd party without asking me if I allow it every time you want to share it.
The other responses captured the essence of what it is, but I thought it might be interesting to briefly discuss how Erlang uses it. As someone who hasn't been able to use Erlang in his day job for a year now, I sorely miss the language.

In nearly every other language, when you call a function, the top of the function typically involves a fair bit of analysis of the arguments to decide what needs to be done.

(That's being generous: typically the entire body of the function revolves around making decisions about what to do, such that you don't know what's going to come out of the function until you've traversed multiple branch options.)

In well-written Erlang, the function itself branches at the top, taking advantage of pattern matching, destructuring, and function heads.

Let's say you're passing around arbitrary data in the form of a tuple that you need to display. Or not, depending on the value of some debug flag.

In Python you might see code like this, assuming that an integer is stored in your program like ('int', 3) and a string might have some arbitrary label, so it's ('str', 'label', 'real string'):

if (debug):
display(x)

def display(x):
if (x[0] == 'int'):
display_int(x[1])
elif (x[0] == 'str'):
display_string(x[1], x[2])

In Erlang, you can branch and destructure at the function head. You don't check the debug flag in the calling code, just pass it along for the function to decide what to do with it; if the flag is false, the function just returns false. (Variables in Erlang are capitalized; the lower-case "strings" in this code are atoms, also called symbols in some languages.)

display(_, false) ->
false;
display({int, N}, _) ->
display_int(N);
display({str, Label, String}, _) ->
display_string(Label, String).

Since you can choose the key data elements in your function arguments and branch accordingly in the function head, it becomes immediately obvious looking at the code how many different ways the code can evaluate, and the destructuring in the function heads means you don't have to waste code chunking the data apart before working with it.

(Updated: forgot to include the debug flag in the 2nd and 3rd function heads. In all 3 heads, the _ pseudo-variable basically says "I don't care what value we have here". Another option would be to use _Debug in the 2nd and 3rd heads to indicate to the reader what the flag is, or use true since we're expecting that value.)
Teen monitoring apps don't work, and drive a wedge between teens and parents
Chalking everything up to “society” is a great way to never get anything solved.

Change starts with oneself. Connecting on an individual level, making changes on an individual level, understanding and valuing even minute consequences on the individual level - that’s what going to bring about permanent change. Not more groupthink.

We have brains and decision-making abilities for a reason. Yes, I understand society has a very influential role in how we go about our lives. But that is not some catch-all excuse for not taking any responsibility for our individual behaviors. There are two sides to the coin that both need to be addressed.
My Favorite PostgreSQL Queries and Why They Matter
Yeah, that's the most commonly referenced standard.

Approaching it from a database perspective (eg sqlitebrowser.org), where we need to both import and export CSV's... it can be tricky.

For example, if an imported CSV file has two commas ",," that generally indicates an empty field. But, does that mean an empty string? Or does it mean we should use the default value for the field (as per database spec)?

That specific case can be handled by a user preference on the import/export dialog ("What to do with empty fields?").

Other's less so. For example, database fields can contain data types (eg images, binary blobs) that have no representation defined in the RFC. Literally any decision about how to encode them is going to be non-standard. Ugh.

There really needs to be a follow up RFC that specifies useful, practical things to tighten up the gaps.
> From the UK it looks like this. Trump used data, Facebook helped, politicians are upset that Trump was helped by the Facebook platform (conveniently forgetting that every campaign before that has used large amounts of Facebook user data), let's punish Facebook.

Bingo we have a winner.

That's exactly what this is really about...nothing more. Our media and political masters are still in deep shock that Trump usurped them and stole the most coveted position from them as an outsider.

Heads must roll! Talk about not caring about it "users"...almost half the population of the US voted for Trump, and these elites couldn't care less about them or the message they are obviously trying to send.
On using CSV as an input format, but wanting a “better” format for storage/manipulation, [csvw][1] is an interesting choice, and can be converted to any RDF encoding.

[1]: https://www.w3.org/ns/csvw
Note that this only works if you're working with small amounts of data. CSV with 5 million lines are no issue at all, just don't try this in Excel.
To provide an opposite opinion, I know I can do all of my groceries online, but I enjoy the experience of going grocery shopping. I like picking out my own produce and meat and seeing what's there. Sometimes I see something, buy it, and look up later how to make something with it. I don't get the same experience online. But I also like making food and try to make things from scratch. Is it efficient? Not in the least? It's an experience I enjoy though.

Your private time is just that, yours. I tried doing the over optimizing and in the end, it stressed me out way too much.
No. Because FB data was used by Trump to win.

FB was very visible earlier too, and the influence it weilded was well known. It was just extremely upsetting that the other side used it this time, and won.

Political narratives world over, have always been monopolized by the left, via institutional control. When narratives are democratized, they invariably move to the right. Social media has democratized setting of the narrative, and that is the reason that we are seeing a wave of right wing populism across the world, from India to UK to the US.

The clampdown on Facebook is an attempt to regain institutional control of the current most valuable means of setting political narrative.
Its 85kb. I wouldn't say its a huge dependency. I rather keep it than having to learn an entirely new framework.
IME none works exactly like Excel and therefore will inevitably fail as users push more and more of it's edges and bugs on the system
Interesting but not sure there is a clear benefit of knowing ahead of time when there's no treatment available. Knowing how you will end will significantly affect your outlook on life.
What's the point of market cap here? It's just (current price)*(number of bitcoins), so if some speculators drive the price up, even if there are low volumes on the exchanges, the market cap will rise by a corresponding percentage.

Hypothetical example: If there is a single trade at say twice the current price, the market cap will double.

It absolutely does not represent how much adoption Bitcoin has.

I would like to see how much "actual" usage there is to Bitcoin as a currency (i.e., sending bitcoin to another person in exchange for goods or services). You seem to believe it's a lot; I don't believe that.
I think a better analogy is bacteria. We healthily carry around about a kilogram of gut bacteria, but far less of some toxin producing strain like Anthrax will kill you.
Show HN: SirixDB – A Time Machine for Temporal Data
That's why we have Phase I trials.
It's definitely a roll of the dice but I'd venture to say that, aside from constant pain and suffering, pretty much anything else is better than Alzheimer's.
Any chance you can drop the name here? I'm a motorhead and my beloved community-supported mazdaspeed community has basically dried up and migrated to facebook...
Damn social logins. The biggest one is Spotify. They require you to make a whole new account instead of just unlinking your FB one, and then all of your playlists etc are gone.

I’m going to set aside a day to migrate all of my services, but it’s going to be a pain. Worth it.
It is even worse when schools try to make these mandatory “on behalf of the parents.”
> let's not forget that these are industry-wide practices and that the hearings have less to do with protecting users than it is political grand standing.

Actually, we're already seeing some real action from Congress. The author of COPPA introduced the CONSENT Act, which seems to bring parts of GDPR to the US.

https://www.markey.senate.gov/imo/media/doc/CONSENT%20Act%20...

The "catch" is that it only applies to "edge providers" (online services), but not ISPs, which I think is FINE. That's a battle for another day.

After all, remember how Google helped in the openness or copyright fights against the ISPs and content providers in the early days (which of course directly helped Google to grow even more as a company)? And now we're stuck with tech companies becoming dangerous monopolies, too.

My point is that I don't mind ISPs actually supporting legislation like this, as long as the legislation makes sense against that group of companies. Once Democrats get back in power, I think we'll have a good chance to pass a net neutrality law as well as a broadband/wireless privacy act, too.
Memorandum for U.S. Owners and Operators Using GPS to Obtain UTC Time [pdf]
A couple of extras:

* CSV files will have consistent EOL markers

* CSV files will always have a trailing EOL marker

* CSV files will never have a trailing EOL marker

* Any file with a name ending .csv is a CSV file (or something close to)

> Excel can losslessly save CSVs it opens

A particular problem we've had many times with some clients is Excel messing around with date/time formats: files with dates formatted YYYY-MM-DD being changed to American style, columns containing both date and time having one or the other chopped off, dates being converted to numeric representations, ...
...PNG24 for high quality, complex logos

PNGs used to be a really bad choice for logos. PNG has a gamma correction value embedded in the image that's pretty much always wrong. It can be omitted, but then a browser can just make something up. If you want your image colors to match your CSS colors in older browsers, don't use a PNG.

https://hsivonen.fi/png-gamma/
Are you referring to vanilla JS as an entirely new framework?
And now you have a "nexus" in California and they think you should pay their state taxes.