skysight-inc/HackerNews huggingface dataset:
What happened to the web's early vision of an information superhighway, an open repository of data that could be linked, shared and remixed?

The efforts (and lawsuits) to lock down and control data on the public web threatens to stifle innovation. Websites are only valuable because they're connected to the internet, which for all intents and purposes, is a general utility. It was funded by the U.S. government, and is now managed by a consortium of NGOs such as ICANN, W3C, etc.

When you publish a website, you're distributing it to the world. It's similar to when you publish a book. It has always been the right of those who buy and read a book to be able to use the facts contained therein. Although readers are not allowed to steal the creative elements, they have a basic human right to use the facts however they desire. And the medium doesn't change this truth -- whether you read the book yourself, ask your friend to read it out loud, or employ a bot to read it. So it should be with websites.

Data placed on the public Web is accessible by everyone and should be usable by everyone. It shouldn't matter who parses the page's HTML, whether it's a person, a web browser, a bot or a robot.

We're starting a movement to ensure that the facts of the world are always available for innovators to build on top of:

https://dataliberationfoundation.org/
What state do you live in?

PS: I took a bunch of time off and then went back to finish my degree and graduated at 32. Still worth it.
A write-up of working in Japan as a non-japanese interested me because of the socialized concerns in the community like banks: a small town banker in Japan feels personally bound to you, and may invest in you, but you need to accept their guidance on spending: Do you need the computer, or is a bicycle a better choice for you with this disposable income: Can you afford the rent in a place of good repute because living in this bad place will affect your longterm credibility which affects your debt/risk ratio to me as a banker. Wow. Imagine US or British people having their bank manager say "I won't lend you for that jetski until you clean up your act and live healthy"
This is the line the Australian anti-encryption bill that past last year was trying to walk with its "no systemic backdoors" clause.
The idea/claim was that the bill only allowed targeted spying, and systemic/bulk spying, so it's okay. But that's really only only a small part of it.
Well, the "real" (read: design) engineering work has always been done by contractors. I literally walked out of an interview for the Navy (NSWC Carderock) when I realized that. I went over to General Dynamics and got a job as a mechanical engineer designing nuclear submarines. NASA is the same way, the design work is done by subcontractors. The government agency conducts oversight. So we, the contractors, sent our plans to the Navy for review & approval. Their job was to ensure we didn't screw up and that our plans would meet the contract requirements.

In my experience NAVSEA (the actual Navy side) were all former senior engineers at the subcontractor. They were good engineers and could smell bullshit easily. But that kind of work is very different than the creative side. Some people like being the reviewer better, and the government benefits are generally better, but otherwise I never saw the appeal.
Exactly. Having a common culture and set of values seems more important to them than innovation.
Expertrec is an end to end solution for site owners, so you go live with a single JS inclusion and pretty much everything else is optional. As a bootstrapped startup, we cant afford to have any free plans, but at 9$ it is totally unbranded experience.
Aravindh, you should certainly try our solution (at least the demo that is automatically built for you) and share your feedback.
Did they get him
Yeah I have bad feeling the things I'm interested in now, I'm only interested in because I don't fully understand them and want to understand them, and that once I do, it'll become as dull as my current work
There isn't though unfortunately. If you allow it audit trail or not it can and will be abused. FISA court being an example of that exact type of warrant abuse. Even without a warrant someone would have to hold the master key or keys that any nation state would go to great lengths if they weren't in possession of them and if that did hold it; they will abuse it.

They seem to unlock most of this info though by attacking the endpoint itself anyway.
I'm pretty sure UCB isn't producing and selling light bulbs, so as a classic NPE (non practicing entity) they are in the eyes of the law nothing but a patent troll.

Not that that may help much.
Counterfactuals are fun. But Historians disagree about their role in the discipline. Climate modelling with what-if feels like its in the same place. Having a good parallel economy of comparable size, and distribution of coal nuclear and wind, and similar de- and re- industrialization is almost impossible.

On balance, I want to believe. Because it suggests that the organising principle is a higher goal, worthy because it achieves something. But thats politics not science.
You should be proud of yourself.
That certainly depends on what part of the US you're talking about. In my experience in the south, working overtime is very rare. Most people have families and are out of the office by 5. Silicon valley might be a different story.
Are you talking about the idea of a military as a whole, or the wars that were involved in right now?
I love history as much as the next guy, and this is exciting writing, but the issue I have with this is that we haven’t seen the end.

That is to say, AI is an unsolved problem, and we don’t really know what the solution will look like. We are in a (the?) golden age for statistical learning but in the end, symbolic processing and prolog like architecture might turn out to be the key.

I will point to someone much smarter than myself — Jerry Fodor — to make the arguments. But basically it amounts to this: intelligence is the ability to reason and our best model for reasoning is linguistic.

Okay, he says it much better than I do.
What's wrong with modsec?
Where I'm from (Scandinavia), we have laws like that. You pay for your and the other sides legal fees.

While you rarely, if ever, see cases where losing parties have to pay millions - I personally haven't seen any like that - you can see people having to pay tens to lower hundred thousand $ in legal fees.

That can be a substantial sum for regular people, and those circumstances happen when the other party has hired in high-$$$ lawyers, and the case goes on for a while. Especially if there's multiple appeals.

So there's always the risk of that.
Great example. I'm told a lot of banking FinTech is emulating ICL George OS inside, for the core registry function which passed audit, so re-implementing risks re-audit which nobody wants to wear. I know from a friend some banks here in OZ pay COBOL programmers to not die, and keep the bits they haven't ported to Java alive across some API I don't want to even dream about. Probably an ethernet emulating an IBM370 protocol which then winds up in a soft-device into some COBOL tape or disk input strategy
While I've been described and perhaps more fitting than not a 'code monkey', I've never felt the negativity implied with that phrase manifest in my life. Perhaps it's because it's just what I love to do, I love writing code and writing code all day while making good money has been pretty awesome. In a way, I have no idea why it's even a negative term.

CRUD apps are an incredibly small segment of the market today. Most of the stuff are much more complicated, and more fun. If you're fed up with what you do at work, do your 8 hours and explore more at home, I always find writing code for my own more fun and fulfilling. You can even showcase this to potential future employers.

I've always managed to find some tangents even while dealing the the most boring of code - some of it automation, I guess using vim for everything helps as well - text editing became almost programming and it's definitely more fun (and faster) that way.
Technically true but kind of loaded statement. For most societies, including the states, immigrants will not increase the crime rate.
I don't recall/don't know. We had a 7.1 earthquake at some point as our latest Exciting Thing, and I think focus probably changed after that.

But for ten months, you would have thought they were looking for a mass murderer by the way they were blanketing the area with fliers looking for any leads in the case.
I recently read the book "The 22 Immutable Laws of Marketing" and it talked about how when a company adds more lines of business that long term it can have negative effects (lack of focus). Do you think Apple has over diversified?
Mountains out of Molehills: a timeline of media-inflamed fears
Funnily enough I was talking to the cashier at a sex shop the other day about what it shows up as on my bank statements. I personally don't care, but was curious.

Turns out it just shows up as the name of the shop, they don't bother to try and hide it these days. Pretty sure strip clubs still show up with innocuous names though, but it's been over half a decade since I've been inside one.
Great book.

I think it's a good time to mention a couple of nice books (related)

1. Elementary intro to math of machine learning [0]. Its style is a bit less austere than that of OP's. It also has a chapter on probability. It could possible serve as a great prequel to the book linked in the OP.

2. The book on probability related topics of general data science: high-dimensional geometry, random walks, Markov chains, random graphs, various related algorithms etc [1]

3. Support for people who'd like to read books like the one linked in the OP, but never seen any kind of higher math before [2]. This book has a cover that screams trashy book extremely skimpy on actual info (anyone who reads a lot of tech books knows what I am talking about), but surprisingly,it contains everything it says it does and in great detail. Not even actual math textbooks (say, Springer) are usually written with this much detail. Author likes to add bullet point style elaboration to almost every definition and theorem which is (almost) never the case with gazillions of books usually titled "Abstract Algebra", "Real Analysis", "Complex Analysis" etc. Some such books sometimes attach words like "friendly" to their title (say, "Friendly Measure Theory For Idiots") and still do not rise to the occasion. Worse yet, a ton (if not most) of these books are exact clones of each other with different author names attached. The linked book doesn't suffer from any of these problems.

[0] Mathematics For Machine Learning by Deisentoth, Faisal, Ong

https://mml-book.github.io/book/mml-book.pdf

[1] Foundations Of Data Science By Blum, Hopcroft, Kannan

http://www.cs.cornell.edu/jeh/book%20no%20so;utions%20March%...

2] Pure Mathematics for Beginners: A Rigorous Introduction to Logic, Set Theory, Abstract Algebra, Number Theory, Real Analysis, Topology, Complex Analysis, and Linear Algebra by Steve Warner

https://www.amazon.com/Pure-Mathematics-Beginners-Rigorous-I...
The iPhone XS is basically the same size as an iPhone 8 with a screen that is 1" larger.
Take a look at the SMR/Glassdoor Culture 500 if you're interested in measuring company culture. https://sloanreview.mit.edu/culture500
Thanks for your insights, and for clarifying (I primarily linked to the article for its comments, which seemed to contain a collection of interesting historical tidbits.)

Again as someone who somehow never got to touch 68k during its day, the level of creativity required in 68000 MM, and the internal state spilling of the 68010 and later, really got me curious (x86 of course always had plenty of curious quirks, but I think I'm too familiar with them at this point %) ).

I'd also still love to read more about the details of the two-68000 design, but everything I could find so far was essentially folklore.
Teach them to code?
One of the scariest parts of this to me is that the vast majority of Aussie developers don't seem to even be aware that such a law was proposed, let along already passed.
Hi good morning
I think that would be a phenomenal boon to society honestly
Other funny thing on that is if you are a citizen of one of the five eyes and china was putting a backdoor into phones it would probably wouldn't matter too much since they have little influence on you unlike say your own gov having that same capability and using it.
That's so great. Thanks for sharing
For me the nostalgia this brought back was a memory of boot sector viruses, particularly the way the 'format' command propagates itself onto the new disk.
Yeah, even though the two aren't necessarily mutually exclusive, among folks I know who work on this there's a pretty good (subjective) correlation between favoring an old age for the moon and being skeptical of the LHB.
I was making fun of the guy claiming pizza delivery wasn’t profitable.
It seems to me that, in order for such an informationally dense language to actually be used, especially as spoken word, it would need to include a layer of error-correcting codes on top of the basic language. That could be a fascinating linguistic concept on its own, especially if one could design the error correcting layer in such a way that a human being (as opposed to a computer) could conceivably become fluent in it.

I would guess the author has thought if this; wonder if it already exists.
I called customer support on a Sunday evening, and quickly got connected to a US-based support person. They sent me a return box overnight. So far I'm happy with the quality of service. The real test will be what happens after I ship it in for repairs. No complaints yet, though.
Right. HN does neither.
I thought I heard it said that poverty needs no explanation. It is the default state of human existence. The real question is why wealth exists.
Somewhere in the sources is the GHOST (General Handy Operating System Toolkit) folder which is where the UI stuff is implemented.

intern/ghost if I were to guess without looking at the actual sourcetree...
The purpose of fake news is to spread, the purpose of real news is to make its creators money. It's not surprising what spreads more..
Have you not noticed that this is the new norm everywhere?
On paper yes. In practice no.
>Honestly there have been very very few times where my knowledge of mathematics has directly helped me with coding . . .

> its not directly applicable unless you are doing graphics programming, AI, data science etc.

Well, those are pretty large fields!

If you ever get to touch machine learning, that's all about linear algebra, sparse methods, numerical methods, calculus in many dimensions (e.g. gradient descent).

Any kinds of image or signal processing, and you run into your old friend Fourier Transform, which is, again, analysis, linear algebra, complex numbers.

In my previous job, I got to have fun computing an orthonormal basis of polynomials on a disk, and doing some linear algebra with that (although to be fair, fields like computational lithography are probably more math-heavy than others).

The amount of programming jobs where math would be directly applicable is on the rise.

That's not why I studied mathematics. I do it because it is an art[1][2], and because I can. But it certainly comes with certain benefits in the workplace.

[1]https://archive.org/details/hardy_annotated/page/n1

[2]https://www.maa.org/external_archive/devlin/LockhartsLament....
They should create some squads to work on cold case files.
I know a (former) coworker that has no higher education earning 6 figures in the software industry, he's in his 20s as well. The software industry is already the best in terms of education requirement - You just need to show them that you have it in you (which is actually rarer than degrees in CS, from my personal experience).
>Colonizing Mars with a small team of experts

Like the thousand people in Antartica right now? I just wouldn't call it colonization.

>The lack of a plausible business model which could profit from having people live on Mars is the main gating factor.

Right on the money here. Save for space research, what could you possibly do on Mars that you couldn't do more cheaply and comfortably in the crowded Earth? Resource extraction only becomes cost-effective if its self-sufficient and automated enough, and which point human presence there would be more comparable to an oil rig than a colony.
https://www.pcgamer.com/skyrim-special-editions-audio-is-not...

Bethesda also shipped the Skyrim remake without replacing the compressed development sound files, making the game's audio worse quality than the 5-year-older original until they patched it decently later.
You're totally right. In our case, our test infrastructure spins up a new Postgres container for every build. Because it's not a long-running database, bloat is not a concern.
>>First you have to locate the carrier. ...This means either a radar location, or a satellite overhead.

These aren't just "weather satellites". It's highly suspected they are capable of tracking carrier groups via infrared:
https://spaceflightnow.com/2018/06/05/chinese-weather-satell...

>> Now you have to prep your missiles for launch which takes time. Let's say 30-60 min.

China's DF-21D and DF-26 are solid-fueled and fired from mobile launchers. In a deliberate carrier-hunting attack the sensor-shooter killchain is also likely to be streamlined, even taking into the account that the Chinese still suck at Command & Control. Overall preptime and killchain delay should be negligible (<30 minutes for the Chinese).

>>> So you just target each square mile with a missile and hope its internal radar can pick out the CVN.

No. These long-range anti-carrier missiles have an almost vertical terminal trajectory and are looking down from high altitude. AN AESA's fast scanning should be able to find and fix a target with a signature as gigantic as a carrier's over a 30km-radius circle without too much difficulty. I haven't crunched the numbers on this personally, but I'll add it to my list of "radar scenarios to do the math on"...

>>>But it turns out that your radar on the warhead was small, with insufficient processing power

The DF-21 and DF-26 are both about 1.4m meters in diameter. You can stuff an AESA as good as any on a fighter into a nosecone that large.

>>>Aegis is pretty good these days.......Then you have to make it past the ESSM missiles.

Even in controlled tests we don't have that great of a pK (probability of kill aka "intercept") against high-speed ballistic missiles. The ships need to use SM-2s and SM-3s. 1x Tico + 2x Arleigh Burke are packing about 300VLS total, and that has to include Harpoons and Tomahawks. Let's assume ~250 SM-2/3s for air and missile defense. It's customary to launch 2 missiles per incoming threat (again, due to that low pK we've demonstrated) but that is still enough to stop 100 incoming (probably bigger than any realistic incoming salvo anyway). Assuming you can LAUNCH the SM-2s fast enough. Each ship would need to fire off 80+ missiles in probably 30 seconds, and I think there is a practical limit for how quickly you can fire from VLS (due to the exhausts and whatnot). It's probably something like 1-2 missiles per second, from non-adjacent cells.

>>>> Say $5M a piece since it makes the math easier (though the DF-21 and DF-26 will cost much much more). 1000 missiles is $5B, plus the cost of all the ISR assets used to locate the CVN.

I've seen estimates of $10-20M for DF-21/26.
-200(don't need 1000) x $20M = $400M
-3 x $100M(??) surveillance sats = $300M
-Sinking the centerpiece of your opponent's Navy, exploiting their Critical Vulnerability to defeat their Center of Gravity, AND achieve major Information Operation success (PR victory)? Priceless.
https://en.wikipedia.org/wiki/Indiana_Pi_Bill
Tree-hugging celebs take jets to extravagant Google Camp
This is the red tinged future linux is headed towards anyway.
Seems like that would have the undesirable effect of making large corporations untouchable by anyone except the government and other large corporations.

If you want to sue a big company for treating you poorly, you risk a very high price of you lose.
A default judgment is just a document that wants you to do something, no different from that TOS that you ignored.
It’s good your feature flags have the necessary...features. The same word is often used for global bools; I wish there was a better word (eg “experiment” or “experiment flags”) or documentation to brag that you’re doing more than simple flags.

I’m also curious what kind of infrastructure you use to affinitize the rollout to particular customers. I’m used to that being coupled to user or device IDs, which I don’t see as a coupled feature of your stack.
I wouldn't rush to assume that immigrants and refugees drive crime.

One thing that hands down drives crime is racist policing.
Thanks, you are correct. I have updated my comment accordingly.
Incentives matter. You must enforce this from the top down, that law enforcement will be measured by community engagement. Action and results will follow.
Wealth divide is incredibly low here. Japan’s poverty rate is among the lowest in the world. What are you talking about?
The ciphersaber idea is great, but the cipher that was chosen for the project has been subject to significant attacks (further developments of the ones mentioned on that page) and has been deprecated in TLS. (The attack setting for attacking RC4 in HTTPS is probably a lot easier than attacking short person-to-person communications, but it's still not a good sign.)

Also, when you implement the ciphersaber, you're still only about 1/4 of the way to the functionality of early-1990s PGP, notably lacking any public key functionality.

> For file encryption, a user need only memorize one key or passphrase. For messaging, users need to exchange pairs of keys through some secure means, most likely in person. Maintaining a list of correspondent's keys or passphrases in a master file, preferably itself encrypted with a memorized master key, is less convenient than public key encryption. But it may be all that is left in a few years if PGP key servers are banned.

> It may even be possible to teach a manual version of the Diffie-Hellman key exchange, perhaps using large number calculators (easily built in Java 1.1). The Diffie-Hellman procedure need be carried out just once per pair of correspondents, since CipherSaber eliminates the need to exchange keys for every message.

Apart from the implausibility of some of this, you have a very severe issue about key synchronization if you literally only want to do a key exchange once. For example, an attacker who can intercept one party's message and then trick another party into encrypting a known plaintext with the same key material (because that party doesn't know that the keystream has advanced yet?) can then decrypt the intercepted message.

Even having the two users accidentally use the same part of the keystream to send separate unknown messages m₁ and m₂ will allow an adversary to compute m₁⊕m₂, which is very bad in many cases. One thing I remember from Dan Boneh's cryptography class is that if either message contains an ASCII space character (' ') at some position, then m₁⊕m₂ will contain the other message's plaintext with uppercase and lowercase inverted (for example,' '^'q' is 'Q').

The ciphersaber idea is conceptually really great, and I love the idea of helping teach people to create their own communications and communications security infrastructure. But I think that, apart from just how archaic the cryptographic technology it teaches is, the project really underestimates how far away this cipher implementation is from a complete system.
But if you didn’t had the trick, CPU intensive runloop ticks could create lots of small objects that were put in the pool because they had a 0 refcount as a function returned the value. That’s why we had the ability to write our own pools.
How to Encrypt Your Hard Drive