skysight-inc/HackerNews huggingface dataset:
Gotten the kid out of where? The article indicates the government very quickly got her out of the detention center, putting her in a shelter since they hadn't found her mother at the time.
150ms round trip California to the Netherlands. Oof. That's like 9 frames of a 60fps video. The speed of light sucks! Someone should do something about that!
Amazon demands Trump testify about the Jedi contract
I've worked in both experimental physics and experimental biology (specifically in drug discovery, an early phase that can lead to clinical trials).

Failed experiments in biology don't make much progress compared to failed experiments in physics. beyond the inability to control for wide range of variables that are normally managed in physics, most people in biology aren't good at running high quality, reproducible experiments that falsify hypothesis. I have seen many coworkers run the same exact gel over and over until they get one that "looks like what they were expecting". I don't see the same level of experimental inadequacy in physics.

The best approaches in biology now seem to throw away the idea that we can construct a rational narrative to explain the biology that causes a complex disease, and more on collecting very large amounts of high quality data to produce sophisticated statistical models that deal with the underlying complexity in a useful way.
The CISO of Equifax assured a reporter it was possible it still could have happened even when patched.

"The Equifax security chief noted that the company continues to fend off attempted cyberattacks every day, and expects hacks to escalate in the future. He said that given how dedicated the Chinese military hackers were, a breach could still have happened even if the vulnerability had been patched. "They're extraordinarily sophisticated," Farshchi said in an interview. "I would say that it's possible.""

https://www.cnet.com/news/justice-department-charges-chinese...

Good to see they are confident.
> mostly at 512 token

GPT uses 1024 tokens context window which does work out to a fair amount (given the massive vocab of 50k+ which means a token can be more than a word), though of course it's pretty limited.

Google's recent Reformer[0] allows you to do attention much more cheaply and I'm currently training a Reformer model that isn't quite as big but has a context of ~64k tokens (though a much smaller vocab). I'm not completely sure if this is the solution but it looks like a step in that direction and so far the model is doing pretty good (I also plan to post the weights when I'm finished, though I am not sure if Google don't just plan to do that themselves).

I am somewhat disappointed they went with just 1024 for this model, too though.

0. https://ai.googleblog.com/2020/01/reformer-efficient-transfo...
I wouldn't call it the "best part." It sounds like you took the service focused angular patterns you were using before and shoehorned them into a React application.

How comfortable would you be allowing an outside dev to hack on your codebase without a _long_ conversation beforehand explaining the idiosyncrasies?
I think the soldering iron has to be in the hunt on all three (important, modern, simple) counts.
> One time I was on a team that did a team building exercise where we went to a local charity for sick kids and performed manual labor all day.

One small company I worked for once did this, but with gathering apples that would otherwise have gone to waste ("gleaning") to give them to homeless shelters or something. Took up two or three hours, total, lots of driving (gas burnt), and so on. Fifteen or twenty people.

We wouldn't even have had to pay minimum wage workers to do what we did to substantially beat our productivity that day. Simply buying apples with ~3x the average worker's hourly wage times the number of workers we had there would have been embarrassingly more effective. I question the entire exercise and charity org behind it, actually. I suspect someone's making money off it one way or another, maybe just by building a "personal brand" as a corporate charity consultant or some such. The market's pretty efficient at getting cheap food to paying customers, and you probably can't beat the efficiency of simply buying food even at minimum wage rates, by manually harvesting from leftovers, however sad it may seem to let that food rot.

It's kinda a dumb idea, if your main goal is improving the world, to such a high degree that I think it'd set of alarm bells for even people who aren't into the effective-altruism thing.

[EDIT] back-of-envelope we could have bought 750-1000 pounds of apples without even getting some kind of bulk price. I think we "gleaned" like 200-300 pounds, tops, and it may have been less. It'd be much higher still if we figured it using company revenue for that span of 3 hours, rather than worker pay, and that's not factoring in all the costs of driving-people-to-the-orchard and all the driving-apples-all-over-the-place that the organization's volunteers did, nor their time. Overall I bet we weren't much more than 10% as effective as just buying apples.
OMG! Do you know the dude in the Terrapin Tacos interview who said he is there five or six times a day, and sits up all night thinking about how good the food is? They pick the rocks out of your beans.

https://www.youtube.com/watch?v=xz8xy61nBjY
Did you know that Java for instance, was originally designed to run on interactive TVs? But then, Java run on many type of devices and in broad range of use-cases (maybe with the exception of TVs :-)).

The original niche for which a programming language is designed may or may not be indicative for what it is used in the end. Julia strikes a very good balance between performance, flexibility (macros) and ease-of-use (default type inference). I won't be surprised if there are other niches outside of scientific computing where these characteristics are desirable.

The biggest obstacle I see for the adoption of Julia outside of the scientific computing realm are the latencies due to compilation. There are already 3-party solutions for this (like PackageCompiler{X,}.jl) but imho they are not robust yet enough for widespread adoption, but this might be about to change when different effort join forces [1].

[1] https://github.com/JuliaLang/PackageCompiler.jl/pull/304
What is the 2020 version of "fax on the beach"?
Yep. In my last dark theme effort. It's mainly CSS work.
"I'll be sure to farm out all my spousal duties..."

Careful that your spouse doesn't prefer the performance of those duties by the contractor to how you perform them.
Get your SPF, DKIM, and DMARC up to snuff. Dmarcian is a good tool for that. (No connection, just a happy customer.)
And yet, as the place where you spend more than half your waking hours, it is your life. If you have the option to connect with the people you are spending your hours with personally and authentically instead of holding them at arm's length with cool detachment, why not? We are all humans. And if you have the chance to drive a mission in the work that you do, then even moreso is there no reason to throw up a false barrier.

More broadly, people are lacking third place institutions like churches, fraternal service organizations, or neighborhood clubs to connect - when their coworkers throw up barriers to connecting, folks get awful lonely awfully quickly.
Any chance that you could share those scripts and cron job? I think something like that could be useful to the system I'm trying to build around text files for my own personal productivity.
Yeah, it's crazy to see how much has been funded by DARPA in particular:

https://www.darpa.mil/about-us/darpa-history-and-timeline

https://en.wikipedia.org/wiki/DARPA#Projects

Some of the greatest hits, at least from my perspective:

The ARPANET -- https://en.wikipedia.org/wiki/ARPANET

The mother of all demos (GUIs, mouses, word processors, video conferences, windows, version control, etc) -- https://en.wikipedia.org/wiki/The_Mother_of_All_Demos

BSD OSes -- https://en.wikipedia.org/wiki/VLSI_Project

Tor/.onion routing -- https://en.wikipedia.org/wiki/Onion_routing

Siri -- https://en.wikipedia.org/wiki/CALO

Boston Dynamics robots -- https://en.wikipedia.org/wiki/Atlas_(robot)

High productivity computing systems -- https://en.wikipedia.org/wiki/High_Productivity_Computing_Sy...

Autonomous vehicles research -- https://en.wikipedia.org/wiki/DARPA_Grand_Challenge

Software-based approaches to biology/cancer research -- https://en.wikipedia.org/wiki/Big_mechanism

The precursor to GPS -- https://en.wikipedia.org/wiki/Transit_(satellite)

Shakey the Robot -- https://en.wikipedia.org/wiki/Shakey_the_robot
> i was surprised at how seldom “junior” was written, e.g. “jr developer.” either employees stick around awhile before calling it quits on San Francisco, or they lie about their job title.

Because "Junior Software Engineer" is usually written as just "Software Engineer", "Software Engineer I", ...?
> when React was launching and Typescript wasn't public

Minor correction, React came out about 7 months after Typescript. That said, Typescript had a promising birth but a rough infancy, so I wouldn't blame anyone for considering it released only after 1.x versions starting in late 2014.
From the description in the research paper of how they compress the memory it sounds like a form of meta-learning.

Perhaps a network like this would be interested in reading the same books more than once. Perhaps it could find favorite books it wanted to read many times.
> because it did not get each pressed button (because the animation was so long).

No, it was because the animation was blocking.
Are you implying realtime notifications on a chat or email service is not a requirement?
There are numerous unjust laws that infringe on the rights of the individual. Not only is it morally defensible to break such laws, but it is a good for respectable people to do so in order to reclaim behavioral territory and psychological freedom from the police state. This demonstrates to others that being a "criminal" is not a moral status but a legal one.

It may even be a social duty.
That's the line that stood out to me. If so, the threat sounds like they could turn it off or reveal everyone at once, not so much a selective attack (why announce it like that then? Certainly not if you were going to use parallel reconstruction to keep the fact secret).

However, the line:

> 34 servers located in nearly 20 countries

Doesn't describe tor. You don't use that many servers (nodes). And it's strength isn't based on number of hops. That's more old school hack a box and put in a chain.

Then what's the cloak? Is their ability that they can easy "go around" somehow any X number of connections right to the source?
Oh I agree with that, I just think that the internal state of the app can be more easily managed if those potential application states are explicitly identified during the design stage.
What does their paycheck say?
Just to give you some info: I have a mater's in literature and a bachelor's degree in film. I am well-versed in humanities and have a knack for it. I'm not even that good at math and technical stuff. Still think Derrida is a charlatan.
I really liked having the keyboard on the G1. Great keyboard on that little thing.

It was only surpassed by the Samsung Sidekick 4G. That had nicely spaced keys for quick typing, and a decent sized screen for the time.

I regret not getting to try out a Motorola Photon Q, which might have been a very nice experience. But it was released only for Sprint. And every expensive at the time.

And now you can't get a decent physical keyboard on anything. I've gotten used to swiping and am decently fast at it after years of practice.
Extended families have more people to share the unexpected burdens—when a kid gets sick in the middle of the day or when an adult unexpectedly loses a job.

Very true. Nowadays society/state is supposed to replace what extended families provide, but they can not replace the warmth of the family.
Haven't pencils always been inexpensive?
> I don't really care much for celebrations

There is an anecdote related to Neils Bohr but possible only tangentially related to him [1]. From the linked article I've pasted the anecdote:

> Bohr used to keep a horseshoe on the door of his house. In European (and Indian) superstitions, the horseshoe is believed to be an object that guards the house against the evil spirits. A friend, upon seeing the horseshoe on the door of Bohr's house, asked Bohr as to whether he subscribed to the relevant superstitions. Bohr replied that he didn't believe in them but he was told that the horseshoe works whether or not one believes in their power.

Team rituals are like this horseshoe. They appear to work whether or not you believe in their power.

1. https://hsm.stackexchange.com/questions/8387/is-the-anecdote...
It might show, though, that those two people aren't very compatible and maybe not a good match for marriage.
I was going to post the standardized shipping container myself. It was apparently a massive boost to transportation efficiency when the industry moved to a standard container that a single simple crane could rapidly load and unload from any ship and load onto a truck or railcar. It seems that, before this, most goods were transported in barrels or other one-off small containers loaded and unloaded from ships by manpower. Could take weeks to load and unload a ship.
*raise executive salaries
> Making both pretty and lean versions of the same app is never an option

To clarify this point, it is entirely an option. Most of the layout done with CSS, etc. these days could absolutely render on older machines if built using different tools. The problem is that a) people want to build it with what they are familiar with, which these days is web tech. That means that those specific abstractions do not exist in that space, and b) very few people these days have the skill, funding, and time to build those abstractions.
Yep, the number has been expanding. I just picked 512 because Bert uses that. But yeah 50k and beyond unlocks new ways of using context. I can’t wait to see how they optimize and improve the reformer model.

I expect there to be an improvement like there was for

BERT -> Albert
That was helpful, especially realizing that part of the problem (at least as you see it) is that the "linking" is unidirectional.

Function definitions/calls are also unidirectionally linked. You can see at the call site which function is called, but you can't see at the function definition the references. But unlike a function, which might be called from many places, it really should be the case that a file is `include`d exactly once.
No informed and literate person ever thought Trump would reduce the deficit. Much like during W's presidency, it will balloon and they will leave it to the next administration to deal with. Meanwhile, Trump's cronies will enrich themselves at our expense.
I think I agree with it. Spies are spies and they're doing their thing. USA should just suck it up and force companies to improve their security.

Should China issue an Interpol warrant for CIA's John Doe that handles US spy assets in China? I am sure there's a Chinese law against it
If I knew I were going to be around people exposed to the virus, I would probably take a short break from hormetic effects on the system. Otherwise I would get at least 30 minutes of elevated heart rate daily to keep the immune system strong. If feasible, I would probably also try to make sure I was getting 8 hours of sleep per day which I know is easier said than done if people are under stress.
Running Linux Programs as Unikernels on macOS
Yes. So long as we had a few reference works, freedom from attack by competing tribes, and landed on productive agricultural land.

Simple radios are very easy and allow us to stick together over wider ranges than the locals, knowledge of simple medical concepts and sanitation keeps us alive and healthy longer.

Understanding how to build effective shelters and storage systems allows us to keep an agricultural surplus which enables some of us to devote our time to bootstrapping.

The biggest problem would be people jockeying for short term power instead of pulling together for long term success.
I don't think it's socially unacceptable to hire someone or purchase something for the benefit of a friend in general, especially if you are in a better position to do so than the friend (e.g. you run a service company in that field or are much wealthier than the friend).

However, in the particular case of moving, a friend might not want an untrusted stranger handling their belongings, so you would need their consent and they might not give it.
It's not debatable...

Unit tests are for testing individual components of your application (web or otherwise)

e2e or integration tests are for testing your application component/lib/api/whatever boundaries
As an aside, from the Wikipedia article:

> ... using treadles to raise and lower the heddles, which opened the shed in the warp threads. The operator then had to reach forward while holding the shuttle in one hand and pass this through the shed; the shuttle carried a bobbin for the weft.

That is a quite a bit of industry-specific jargon packed into a single paragraph. Without context this could easily be mistaken for Star Trek jargon.
>If that's the bar, then we haven't seen any meaningful advancements ever since the Xerox PARC.

Yeah, probably so. It just so happens that I built my first PC sometime around 1994 or 95 so Windows 95 is the first graphical OS that I can personally remember.
You are right that abort to surface is non-trivial.

I didn't work on Icefin, but I did write the comms-lost procedure (among many other things) on a previous ROV/AUV that was deployed in Antarctica to go under the Ross ice shelf. Britney Schmidt (one of the investigators quoted in the article) was the PI of the grant for that project as well.

Our AUV was deployed through a hole drilled in the sea ice and controlled via a fiber optic cable. It was used as an ROV in most circumstances, although we could preprogram an entire mission to be carried out autonomously. In the event of the cable breaking the submersible had to navigate via dead reckoning to get back within range of the acoustic beacon at the deployment spot. The AUV would follow the acoustic beacon until it was within visual range of a flashing led rod and then use computer vision to guide the AUV into docking on that rod so it could be recovered.

If an error occurred under sea ice then we could surface and bring out heavy equipment to drill a new hole to recover, but the ice shelf was too thick to drill through. We did have a magnetic beacon on the AUV that helped with location if we needed to recover after a failure under sea ice.
Thanos, is that you?
Can you comment on why people who like Redux on React don’t use it much when moving over to Flutter?

I’ve heard “yea, you can use Redux, but don’t” a lot.
I believe the transformer-xl pre-trained model can also be downloaded, to provide a similar long term memory functionality as the compression transformer. I don't have a direct link, but it's available via huggingface https://huggingface.co/transformers/pretrained_models.html
Reduce, Reuse, Reconsider
Amazon Looks to Question Trump in Pentagon Contracting Case
I am an occasional user of Maps, YouTube, Blogger and Translate. Never used Chrome, and all of these properties work just fine and have not tried to push Chrome.

I'm also using a stock Android and have never used Chrome on it. Play Store, Play Games, Find my Device, and the Google app work just fine and haven't tried to push Chrome either.

I guess I should prepend these observations with "Yet", as I'm not at all of the opinion that it'll never happen.
I can only imagine a French president announcing even 1 single billion for a « space force » project. All he would get is an instant a civil war
Reading the article my impression was that it was a device well ahead of its time.

The CPU was some oddball thing much faster than its contemporaries that no doubt cost and arm and a leg. The battery technology wasn't ready so they had to compromise on life. The cellular modem technology was first gen: slow, expensive, unreliable, and without an Internet to connect to. The demo had them sending a fax!

Plus they had to build the OS from scratch with an entirely new paradigm (no keyboard!). And it had the unfortunate first gen pen-interface mistake of focusing heavily on handwriting recognition tech that never worked properly on that generation of hardware. Even today its pretty iffy, and virtual keyboards are the preferred solution. The only company that kind of got away with it was Palm, and only because they invented a new alphabet that would be easier for the computer to recognize.

It also goes to show just how much of design is not only coming up with the ideas, but realizing when the technology has advanced to the point where they can be practically implemented.
What they don't tell you is that these summaries are always hand picked from a few that were generated.
I'm sure you could. Not sure why one would want to.
I disagree, given that as I mentioned, those machines were manufactured at some point in time, in the last decade.

From Thinkwiki[0]:

As successor of the 600 series, the T series became IBM mobile productivity
line. Usually leading the ThinkPad range in technology, innovation and
price, the T series was intended for the travelling businessman -
comparatively more stylish, functional, and rugged machines; and easy to
disassemble for repair or upgrades."

The last T-series Thinkpad laptop with non-soldered ram was manufactured in January 2018[1].

[0]: https://www.thinkwiki.org/wiki/ThinkPad_series

[1]: https://en.wikipedia.org/wiki/ThinkPad_T_series#Specificatio...
I'm from the DeepSpeed team, we're happy to answer questions if people have them.
97 is ancient history in climate modelling
>Am I the only one who hates graphics on t-shirts? If the design doesn't serve a clear purpose in signalling something about the user, I want it gone. I'm not convinced that we've seen any meaningful advance in t-shirt design since Windows 95.

I don't know if this helps or hurts your point, but I do in fact also hate graphical T's. All of my T-shirts are solid colors and most of them are black.

>What is the "clear purpose" of MacOS UI to have rounded corners, or the status bar to be translucent, or for the "genie" effect of minimizing an app.

Thankfully I don't have to use macOS very often, but I don't think any of those serve a purpose and they constantly (but mildly) annoy me when I do have to boot up my mac. The minimization effect is important, but it should still be fast.
rpi3 didn't have more than 1GB of RAM for the software issue to be a limitation in the first place. Rpi4 launched in summer 2019 but nobody was able to get it to boot Windows 10 until January 2020.

I.e. it's only been a known limitation for 2 weeks. I'm sure someone will figure it out.
Recursion visualized and explained with boxes [video]
People have been saying that for years.

Blue Origin is nowhere close to SpaceX. They are a fun R&D project silently farming out refined small aerospace tech improvements to various space agencies.

They haven't even achieved a single orbital launch to date.
SpaceX achieved orbit 12 years ago.
Any plans on training other (non nlp) huge models using ZeRO?

Specifically for Transformers - any plans to train a big model with a bigger context window?

Not that this one isn't very impressive, of course.
This is precisely what I'm doing right now.

I want to get into one of the FAANG/Unicorns (financially motivated). I do LC everyday, been doing this for a year for now, still not at FAANG/Unicorns. I'm getting sick of doing just LC but hey, I need the money (have some people I need to support), so here I am slaving over LC lol.
I'd be more wary of a sneak attack from Antarctic insurgents first.
An interview, today, with Riehl: https://www.youtube.com/watch?v=sfXn_ecH5Rw