skysight-inc/HackerNews huggingface dataset:
What if it was a compile-time option?

If those capable were compiling and sharing versions of Firefox without some of these "features", perhaps some users might be interested.

Bias/ignorance: I like to use smaller software for doing TCP connections and HTTP requests that require more modest resources and shorter time to compile; often these projects provide many compile-time options. There are many, many examples of such software. First example that comes to mind for some reason is socat, if one needs an example of what I mean.
Good frameworks or ORMs has hooks that can ensure things happened (e.g. file deletion) BEFORE the final commit. It's very easy to do this nowadays, you don't have to implement it yourself.

You can't get away without files either. Suggesting that you only need a database for everything implies that you store every type of data in it which is not possible long term. Some type of data just doesn't fit there, especially files.
Or, you can make this "floor tracking" so difficult and circumventable that people start to question it and decide that new pair of shiny shoes doesn't deserve the added hassle of walking in them.

There's that producer of floors that stands against these forms of tracking and says "go to the stores that buy from us, they won't track you!" So this benefits the stores that but from them, the floor maker and the store's patrons.

But this analogy broke down pretty soon this way, didn't it?
So your investment is basically a proxy for stock prices? Why not invest in those stocks directly?

Although if all the net worth was due to house price appreciation, stock options don't seem to be making up much of net worth, or weren't included, either of which seems to undermine your argument?
Or you can use a database that supports something like SQL server's FILESTREAM [1]: "FILESTREAM enables SQL Server-based applications to store unstructured data, such as documents and images, on the file system. Applications can leverage the rich streaming APIs and performance of the file system and at the same time maintain transactional consistency between the unstructured data and corresponding structured data."

[1] https://docs.microsoft.com/en-us/sql/relational-databases/bl...
Nearer 10-15% in the UK. If you manage to find a good one they're definitely worth it, but the problem is, at least in my experience, the majority aren't.
http://hackage.haskell.org/package/pipes is the first that comes to mind.

And just Haskell programming in general involve composition Effects are monads and program composition is composition over kleisli arrows .
Let me expand a bit on the origin of category theory in mathematics.

Mathematics is most commonly described in the language of set theory, where objects are constructed from basic building blocks to create bigger blocks. This is much in the same way as algorithms are described in something concrete, say a programming language.

At some point, certain high-level constructs started to appear, where the same high-level behaviour was exhibited in otherwise completely disconnected fields. Explaining what is going on then started to become messy, for example take following quote from Hatcher's Algebraic Topology concerning covering spaces: "This is often called the Galois correspondence because of its surprising similarity to another basic correspondencein the purely algebraic subject of Galois theory". The problem is that in order to understand this, the reader has to understand two fields which are not at all connected and furthermore, the relationship looks nothing alike in the language of set theory.

Category theory was invented as a formal language which could describe such high-level behaviour. In this language this language we would could now say that there is an "contravariant equivalence of categories", which helps if you've seen it before and doesn't help at all if you haven't.

So category theory is massively useful in understanding the similarities between fields, and can be used to transfer understanding from one field to another. It it also useful for understanding more abstract fields where the intuition must be gained by analogy with something more concrete. It doesn't do much in itself, and I don't think it makes much sense to study the mathematical aspects of category theory without any good examples to apply it to.

What does that have to do with engineering? I'm not expert here, and haven't yet read the linked book, but one could hope that certain similarities could be described in terms of this new language. Then concepts which now only live on as the expert experience of working practitioners, might be written down and hence taught directly rather than indirectly. One could hope that certain problems have common solutions which can be re-used across fields.
Much are, a good travel path is to follow the plan in the Awodey's book they start with complemented with the other items as needed, because in CT examples and alternative viewpoints of the same topic are much helpful.
I also chose this route last June. My coworkers upgraded to the new rendition later and I've since listened to them complain about the keyboard and mess around with adapters in literally every meeting room. The hdmi port is incredibly useful, I've never had issues in any meeting room and it's inclusion means I never have to carry adapters around. Not so with my colleagues, they need one even just to share files with a thumb drive.

I hope someone at Apple comes to their senses and makes the next big refresh of the Pro turn it into a Pro computer again.
Hacker Breaks into French Government's New Secure Messaging App
Yep, PEGs are seriously underutilized. Here's a nice introduction using LPeg: http://leafo.net/guides/parsing-expression-grammars.html
> Given the centrality of linear algebra to applied mathematics (even in places where you wouldn't first expect, like the theory of regular expressions and finite automata)

Where can I read more about this?
Hey! I'm a really big fan of this idea! Well done on tackling something really important.

I think the examples you've chosen are good but not great examples of where you can add significant value. A house being rented where there are a few variables and a good/better/best outcome is not especially gnarly Excel for the Hacker News audience. I think marketing and sales forecasts and stock option pricing and DCF might be more impactful, if more esoteric, in showing the power of what you're building.

BTW, it'd be cool to be able to anchor a variable to a historical base or average. So maybe if you have seven or eight forecasts of CAGR, Casual could accept 'citations' and in its output show a user of the model that this isn't totally speculative.

Love what you're doing and have signed up. Well done again.
Coincidentally, I came to this fresh from watching "Database as Filesystem"[1,2], which takes a different view:

> Most network file systems are either a layer over an existing filesystem (NFS, CIFS), or are develped from scratch to have separate, replicated, purpose-designed databases for metadata and object store (GFS, Glusterfs). At the same time, most database engines provide (or can be coerced into providing) replication and all the ACID properties needed for a high-performance filesystem.

> Idea: Use a database engine (Postgres, MariaDB) on raw partitions with a fast separate nVME log file; build POSIX file system semantics on top. It's pretty obvious that this could work; I'm just starting to implement it so performance and durability can be measured.

Epic fail fans and optimists alike will be excited by an actual implementation attempt, I guess :)

1: https://www.youtube.com/watch?v=wN6IwNriwHc

2: https://2019.linux.conf.au/schedule/presentation/212/
> Google Chrome, Opera, Microsoft Edge, and Safari enabled hyperlink auditing pings by default... will no longer allow users to [disable it] in the future.
Is it happening because of Python getting more popular or getting more complicated to use?
I read the following tutorial on the topic few years ago and it has really helped me with commit messages:

https://chris.beams.io/posts/git-commit/
From the mdn page on the `a` element, the section on the `ping` attribute says:

> Contains a space-separated list of URLs to which, when the hyperlink is followed, POST requests with the body PING will be sent by the browser (in the background). Typically used for tracking.

Does this mean that if I put a proxy between the browser and the internet I can block this kind of requests? (of course at the expense of requests that contain that same body for other reasons, in which case I wonder why they didn't add a specific http request header to clearly mark those requests as pings)
In Australia it’s 6-8%
> the stock market is the better investment

buying a house to live is not an investment, and i should think that people ought not to treat it as such. Buying a house gives you stability and security for shelter. It's quite possible that renting is cheaper, but you also can't do certain things while renting - such as small renovations (some places don't even let you nail a painting on to the wall).

Investments in real estate is a different ballgame to buying your home.
A sentence must have a subject and a predicate, and a verb in the infitive form can't be a predicate (it's usually going to be some kind of complement). 'Fix the bug' is usually taken to be a sentence describing what you meant the commit to do, which is why the imperative is the more likely interpretation.
Anytime you see the need to fix your credit score, remember we have some hackers who are perfect in helping you do that and the standard of their permanent solution towards FICO score upgrading is so amazing. I had a very low credit score of 400 and was quickly upgraded to 810 within 7 working days. The fee I was charged was nothing compared to the house I now own and live in with my family. I encourage those who need their services to contact them at WESLEYCAGECREDITEXPERT@GMAIL.COM
Is that Washington D.C or Washington State?

State I'd be less surprised at, they've got quite a few large Comcast offices dotted around Seattle and Everett, and one in Vancouver. Very likely "leaned" on them about municipal broadband rules
Getting an exact port like SMB is very impressive both to the initiated and the uninitiated. Great Gianna Sisters aside, this SMB port is impressive. To the uninitiated it's impressive because they may have never expected the C64 could do such a thing. But that's fine.

To the initiated this port is impressive because of the level of polish; attention to detail and quality of the gameplay matching the original.

Anybody can carve wood but only a great artist can do it very well.

This is a game not a tech demo. The Shadow of the Beast was a demo even on the Amiga.

Where we agree is R-Type. Superb.
This is probably hinting at a similar announcment Red Hat will do on 1st January 2019.
OpenCV-Python Cheat Sheet: From Importing Images to Face Detection
Excuse me for not being impressed. I think you're unaware of the testing done on the European side

No affiliated, but by the way did Qualcomm do this? https://www.youtube.com/watch?v=ROZCTtgOn6s

> producing networks very sensitive to site planning to work AT ALL

It's funny that you think site planning is as flexible as you imagine. It usually isn't.

That being said, there is crap on both sides, but the focus on Qualcomm to building a closed system doesn't win my sympathy.
I've always use https://www.gokgs.com/
quite a lot of people at the time I was playing, with lots of different room (by country, interests, level, etc..)
But I'll definitely give online-go a try ! (interested to see a well made software about go ! KGS one is quite old school..)
2020 of course
This guide is strange. The order of rules is in no relation to their importance: Imperative, Capitalize, Self-contained, Explain, Avoid "stuff", Length limit, Consistency.

That's like a health guide listing: Circumcision, Limit coffee, Exercise, Vitamins, Avoid "Russian roulette", Vaccination, Brush teeth.
Climate Change – The Facts: BBC Documentary with David Attenborough [video]
Hello HN

I’m Joey, the maker of Darwin Mail.

—

Darwin Mail aims to help you be your most productive when dealing with emails & todos.

Problem
Inbox by Google was one of the best products they ever made. And then they shut it down.

Solution
Introducing Darwin Mail, which aims to replace and become better than Google Inbox ever was.

Features
- Snoozing, Reminders, Dark Mode, Undo Send, Custom Backgrounds, Templates, & much more according to your requests!
https://www.darwinmail.app/feedback.php
https://twitter.com/joeytawadrous

Darwin Mail will evolve to become great over time, thanks to its users, and thanks to you.

You're welcome to join me on this journey ️
pretty fair? you would trade your youth for $80k a year? i think that's an egregiously low amount for the way a person in prison spends that time.
Show HN: I Built Darwin Mail as a Google Inbox Replacement
This is just the vague bullshit artistry of stylometry. It's like phrenology or "psychic detectives" standing in as a form of pseudoscience, for those moments when we lack a means to describe true methodologies, and need an alternative form of evidence fabrication to service parallel construction's objective.

In this case, scholars enjoy and admire Tolkien, and it's fun for them to validate his ideas and steal a headline or two. Thus post-hoc rationalization leads them to negotiate a codified reasoning behind Tolkien's linguistic gut instincts.

Viola, now they earn geek credibility and we all can cite their pseudoscience as precedent for our own purposes.
Hello HN
I’m Joey, the maker of Darwin Mail.

—

Darwin Mail aims to help you be your most productive when dealing with emails & todos.

Problem Inbox by Google was one of the best products they ever made. And then they shut it down.

Solution Introducing Darwin Mail, which aims to replace and become better than Google Inbox ever was.

Features - Snoozing, Reminders, Dark Mode, Undo Send, Custom Backgrounds, Templates, & much more according to your requests! https://www.darwinmail.app/feedback.php https://twitter.com/joeytawadrous

Darwin Mail will evolve to become great over time, thanks to its users, and thanks to you.

You're welcome to join me on this journey ️
FreeBSD Images Reworked with ZFS on Linux
If you're in the UK, you can watch on iPlayer:
https://www.bbc.co.uk/iplayer/episode/m00049b1/climate-chang...

I hope the BBC won't remove the YouTube link, this is one of those documentaries that everyone would benefit from seeing.
I am a mathematician and generally bearish on category theory in programming. The best argument for it I've seen so far is that it can inform the design of your system to give it desirable properties, like how the DVCS Pijul [1] bases its data structures on patches and its merge operation on categorical pushouts [2] -- also explained at length in a series of blog posts [3]. I found the whole idea and reasoning behing the merge system very convincing, and am not sure it could have been arrived at or explained as clearly without category theory guiding the way.

[1] https://pijul.org/
[2] https://arxiv.org/abs/1311.3903
[3] https://jneem.github.io/merging/
What a horrible idea

Buy-to-let is causing immense social and economic problems in the UK.

It's a nice way for the rich to tax the poor.

Atlas shrugged.
CFT FreeBSD with ZFS on Linux
I think you are confusing tribal instincts (ie thought patterns and emotional drives) with tribal entities (ie the emergence and labeling of tribes themselves).

A given instinct (ie predisposed thought pattern or behavioral tendency) potentially applies to everything we do. In particular, our tribal instincts don't suddenly stop affecting us just because we're interacting with something that doesn't resemble a traditional tribe.
They also value corporate profit.
Is it already possible setup a multi-room audio network by providing some command line arguments to gstreamer?
Seems like the most difficult programming is no longer cache invalidation and naming things. Its now about strings, and to duplicate arrays ... The stats are skewed because hordes of beginners. Mainly driven by what schools teaches and what languages has the most hype. That said Python is huge
. Damn you significant white space.
While a false DMCA takedown request can be fined and ultimately punished with jail time, most of the casework on this has clear malicious intent. These are parties that send out a notice just for articles or posts that are critical of said party. In these cases, you had a human on one side knowingly filing a single false DMCA takedown.

http://www.aaronkellylaw.com/consequences-of-filing-a-false-...

These are cases of programmers creating takedown bots with false positives. Do the programmers know that there will be false positives? Yes. Do they not make a good faith effort to prevent those false positives? Probably. Good luck proving this in court though.
Lattice theory is it’s own field that exists outside of and before category theory. All lattices form a category, though, but not vice versa.
He explains in the article that he couldn't do it with History API since it is throttled by the browsers.
Yup, there was a single bug here (which I wrote; serves me right for blindly trusting a mail addr parsing library), which boils down to:

$ python -c "import email.utils; print email.utils.parseaddr('bob@evil.com')"
('', 'bob@evil.com')
$ python -c "import email.utils; print email.utils.parseaddr('bob@evil.com@gouv.fr')"
('', 'bob@evil.com')

We deployed a fix within about 90 mins of being alerted, and also released an security update for anyone else who is in the same situation (which is very unlikely):

https://matrix.org/blog/2019/04/18/security-update-sydent-1-...
US authorities make arrest in mysterious raid of North Korea’s Embassy in Spain
If I follow a twin-ideology and the world falls to ashes, at what point does that love affair fall apart? Does it ever? There are people in Venezuela who support true socialism even right now.
That such comfortable dualism might result in such horrific results, almost as if both had a wrong concept of human nature.
Maybe due the usage of Python in AI
But "For long commit messages, give a summary in up to 50 characters first" solves that as well. There are good
reasons to use longer commit messages:

* Link to issue in tracker (Projects can liver longer than the use of a single tracking software or use multiple in parallel - e.g.: public and private ones).

* Important changes in behaviour might warrant a deep link into the relevant docs, even though they are part of the commit.

* Justification why something was changed can be lengthy, especially in a loaded environment (crunch time, intra- or inter-team politics).

I am aware that various workflows exist, supported by various tools, that at least partially solve the problems I mentioned. But the larger the number of people involved or the longer the history of a project, the harder it tends to
be to agree on a complete chain of tools just for the sake of keeping commit messages short.
Hmm, I think it depends on the case. Sometimes it's appropriate to leave comments on the file, while sometimes trivial changes don't need to be mentioned and explained only at a commit message.

Oh and while it doesn't "live" with the code, I can at least look up a line in question and see which commits have changed it, along with their commit messages.
Ask HN: How do I improve our data infrastructure?
I was just hired as the first permanent data scientist in a big corporation. They’ve previously relied on consultants to build the infrastructure and the data science pipelines. We’re still around 10 people in the team.

The code is not pretty to look at, but this is not our biggest problem. We inherited a weird infrastructure: a mix of files in HDF5 and Parquet format dumped in S3, read with Hive and Spark.

Here are the current issues:

- The volume does not require a solution that is this complex (we’re talking 100Gb max accumulated over the past 4 years)

- It’s a mess: every time we onboard a new person we have to spend several days explaining where the data is.

- There is no simple way to explore the data.

- Data and code end up being duplicated: people working on several projects that require the same subset write their own transformation pipeline to get the same results.

Am I the only person here who finds it completely insane?

I was thinking about building a pipeline to dump the raw data in a Postgres and then build other pipelines to denormalize and aggregate the data for each project. The difficulty with this, and any data science project is to find the sweet spot between data that is fine-grained enough to allow to compute features, but fast enough to query to train models. I was thinking that in a first iteration, data scientists would explore their denormalized, aggregated data and create their own feature with code. As the project matures we could tweak the pipeline to compute the features. Do you have any experience with this?

Finally, I love data science and I really don’t want to end up being the person who writes pipelines for everyone. Everyone else is a consultant, and they don’t have any incentive to care about the long-term impact of architecture choices: their management only evaluates delivery (graphs, model metrics, etc.). How do I go about raising awareness?
Why Your Startup Shouldn't Pay the State of Texas $750
Probably both. Python ecosystem is expanding super fast. Look what is happening in data-science. Newborn Python libraries getting outdated too soon just like in JS ecosystem.
> 1. I think only ~1/150 companies I talk to are actively hiring part-time engineers, so it's unlikely I'll add this category any time soon... if ever. (Sorry!)

That’s sad to hear. I’m currently working part time (I value my free time much more than the money I would make) and it took quite a bit of effort to find a place.
Solving small algorithms and problems in a functional way
I have started a repo to implement programs like sorting algorithms, trees, divide and conquer etc in a functional way. These are all familiar problems that we have encountered in academia and are asked in interviews since ages.

I have started implementing these algorithms using languages like Scala and Clojure, though most of the implementations are in Scala. I have tried to keep the functions pure, data structures immutable (except in the case of heap sort) and used recursion. My next step is to make these implementations as efficient as possible - close to the performance of implementations in OOPS style and use more functional concepts in the implementation.

I see that people are liking the project. But very few are stepping up to contribute to it. If are interested and think that this is a good project to work on, feel free to contribute:)
Maybe Civil Society's empathy was exploited a bit too much, a bit too brazenly. If that's the reason, insisting the show must go on won't get you much empathy.
Depends on what you mean by availability. AWS S3 does return 500 errors from time to time and you are supposed to retry. There are also opaque rate limiting. These are mostly hidden from you if you use the AWS sdk but still is something to be aware of if you are using it in scale.

And we haven't even started to talk about eventual consistency.

I am the author of goofys (which exposes s3 like a filesystem) so obviously I believe this can work, but you do need to understand the tradeoffs (or you use goofys and hope that the tradeoffs I've made are correct :-P)
That's an interesting point.

It seems everybody was overinvested in Java but nobody wanted to take care of it. And then Oracle, as much as it was "for bad reasons" took it and keeps developing it.

So Java was Priceless and Worthless at the same time it seems.
I don’t know PLT very well but wouldn’t top/bottom also be considered terminal/initial objects in categorical terms?
Scientists restore some functions in a pig’s brain hours after death
I just stumbled across this: https://forum.bubble.is/t/shoutout-to-bubble-45k-mrr-benchma... while looking at bubble.is (tool for code-free development of web applications).