jkeisling/hacker-news-corpus-2007-2022 huggingface dataset:
I only recently started using it, but I think most of the limitation on metadata is from git itself. (Remember all the metadata is in git; the data is in the "annex".)

This person said they put over a million files in a single git repo, and pushed it to Github, and that was in 2015.

https://www.monperrus.net/martin/one-million-files-on-git-an...

I'm using git annex for a repository with 100K+ files and it seems totally fine.

If you're running on a Raspberry Pi, YMMV, but IME Raspberry Pi's are extremely slow at tasks like compiling CPython, so it wouldn't surprise me if they're also slow at running git.

I remember measuring and a Rasperry Pi with 5x lower clock rate than an Intel CPU (700 Mhhz vs. 3.5 Ghz) was more like fifty times slower, not 5 times slower.

---

That said, 500 million is probably too many for one repo. But I would guess not all files meed a globally consistent version, so you can have multiple repos.

Also df --inodes on my 4T and 8T drives shows 240 million, so you would most likely have to format a single drive in a special way. But it's not out of the ballpark. I think the sync algorithms would probably get slow at that number.

It's definitely not a cloud storage replacement now, but I guess my goal is to avoid cloud storage :) Although git annex is complementary to the cloud and has S3 and Glacier back ends, among many others.
It's probably the highest brow of the mainstream (ie, non FT) newspapers. It's seen as less try hard and pseudointellectual than the Economist i think.
I wasn't quite aware of this because there are slight inconsistencies in some programs and between OSs.

e.g. in powershell on Windows, Ctrl+Backspace deletes the word part, but in cmd shell, Ctrl+Backspace deletes until whitespace. The keybindings to delete word also vary on Windows vs MacOS (Alt+Backspace deletes a word on mac, but deletes the whole line on Windows. Windows uses Ctrl+Backspace for that).

I was also confused since by-default Emacs doesn't treat `_` as a word character.
I used rented renderfarms a lot for VFX work. And many of those had a "if your workload stays like it is it will cost you roughly X after n frames rendered"-feature. Otheres made you transfer money first and you would get a warning before that money would run out.

The problem is that you can run into unexpectedly high cost without warning or option to decide whether it is worth it and one of the solutions would be to just tell people when the rate at which they use your stuff increases or decreases by a certain threshold. And because they can bill you, they also know (roughly) what the things that you use cost.

I never used AWS for serious things, but not being able to decide my spending will be a serious argument against it.
C# has been an ECMA standard for years, they are just changing the process.
Please do not use 4 spaces to indicate quoted text. Or, if you do, please make sure you add line-breaks.

EDIT: using four spaces to indicate quoted text means mobile users have to horizontally scroll the line of text in order to read it.

http://imgur.com/v9gbR6m
> yet another way linux has warped my mind.

Probably my favourite line on the site.
Not to minimize what Stross managed, but one of the reasons why he was able to spool out this stuff was because he was on the same transhumanist/extropian/cypherpunk mailing lists where a lot of these concepts were being thrashed out.

I feel like he contributed a lot to gelling those ideas together, but he didn't really predict them so much as extrapolate them out -- plus, as others have said, sketched out their downsides. Which is what SF authors are meant to do! Everybody on those lists thought that they would become world-changing technologies -- Later Charlie carefully added the "...and what if that was a really bad thing". Chaumian e-cash had already launched and gone bankrupt by the time Accelerando was being written.
This does seem to be a reasonable amount of time to scrub institutional memory within the band of middle management ultimately responsible for the decisions and culture of the institution. Seems like a topic ripe for management and I/O psych research... I assume something like it has already been well tread.
I'd like a filter for items flagged as "nsfw"

This one was embarrassing:
http://hugegif.com/#r/perfectloops/1ys9hb
Perhaps the blogger is not aware that, even if the tons of documentation and data in the National Archives were lost, there are three actual rockets on display across the country, and a good number of stored spare engines and other components. Ars Technica recently ran a story on reverse engineering an F-1 engine to aid in the design of a new heavy lift engine.
Surprisingly actually happened: http://www.snopes.com/autos/law/noplate.asp
It's much easier to consult, with the added benefit of (generally) being more tax efficient.

The problem is that companies rarely offer that kind of path - most often because they don't need true specialists or don't need them all the time.

Make sure a company really needs a specialist role:
In some companies you'll see a fake tech specialist path being given to senior engineers who want more money or managers who were too troublesome to keep on the people side. It's not any different from normal senior contributor.
The VP or CTO generally have an incentive (which often goes against the business) not to lose staff (especially senior level) as they won't necessarily be able to claim back the budget from the business and won't make them look as good as it could ("my department is bigger than yours").
Eventually results don't happen, the board gets tired, fires everyone (or create unfavourable conditions) and the corporate cycle restarts.
My organization was part of the author's book tour, we had a webinar with her earlier this year as she provided the book to the entire company. A couple of takeaways:

- Author believes (or is at least attempting to make others believe that she believes) that the NSA is benevolent and not committed to any specific domestic program

- Author frequently stated that 0-day purchasing platforms should not exist as it is a matter of opaque moral policy.

- Author frequently states that contractors like Immunity are problematic because they sell tradecraft to "bad nations" for profit.

- Worth noting that the author is also a NYT contributor and clings to a lot of those same notions.

The overall sentiment of the author after her webinar was that she was egotistically confined to believing in US supremacy and very much in the midst of an ideological war against competing beliefs. Probably not going to get far in her book either in light of that webinar.
People just don't understand how the market works. When you click sell and get back a confirmation you have not sold. You have agreed to sell, in two days.
> Portability is not hard. If you write standard C/C++ that does not depend on undefined behavior (like wild-ass pointer casts, etc.) you will be fine 99% of the time.

This is not my area of expertise, so I'm not the one to write the rebuttal, but it seems that "---- is not hard" is never anything more than an invitation to someone who fully understands ---- to explain why it is hard.

Succinctly, serving 99% of the use cases with no effort mainly seems to be a recipe for making sure that, when one hits those 1% problems, one has no idea how to deal with them. I suspect that portability is one of those things where it's easy to do a mediocre job but hard to do a good/robust job.
Anecdotal, but i just bought the iPhone 12 mini, and i absolutely love it.
They actually buy a ton of data from others. So they are encouraging a market that thrives by selling our data without our informed consent.
I would say that's a false equivalency. In the Apple case, it's possibly gaining via marketing and driving people to paid apps that Apple gains revenue from.

Please don't misread me though--I'm glad Apple is doing this, I just don't think they're heroes for it.
> Employers that allow people to "work on their passions" use that as a bargaining chip to lower salaries.

That sounds like every startup job pitch.
Agreed. He's a great example of how successful storytelling can come from charisma and passion as well as diction and articulateness.
He tears up at the end, just barely losing composure, as he explains what magic--and, I imagine, life--means to him. I was certainly touched.
Could you explain what you mean by this? The writer of the blog didn't publish her questionnaire or responses so there's a question in my mind of how effective it was.
She did publish her questionnaire, it's right on the post.
I worked for Public Works and Services Canada, and all our sites must be compatble with IE 6 and Firefox 3.0 before they are pushed to production.
Heh, point taken--I banged it out in 3 hours this morning. Though I must admit laughing a little about being called a newbie! Not like I'm hard to find on github or freenode... :-)

I only submitted because a.) it takes advantage of some non-obvious ssh features I have to look up every bloody time, b.) friends have asked for it, and c.) yesterday's front-page submission about theft made it seem apropos to remind people how easy this is to accomplish.
Yea, you're right. Not sure how I got sidetracked into posting that.. This is what happens when I try to multitask :|
I can think of 3 potential bubble bursters
1) Social media companies (2nd party advertisers)
2) Webtilities
3) Taps

IoT to the rescue!
The following article is one of my favorite primers on Character sets/Unicode :
https://www.joelonsoftware.com/2003/10/08/the-absolute-minim...
> Good calendar software also helps everyone.

Tell a neurotypical to use a calendar, and they'll just do it.

Tell someone with ADHD to use a calendar, and they'll spend 4 hours shopping for the perfect one, then forget to check it, forget to put things in it, forget to carry it with them etc. You'll say "why can't you just keep a stupid calendar" and they'll say "the calendar doesn't work".

"Use a calendar" is a piece of advice that works for neurotypicals, but not for people with ADHD.

Conversely, "have a fidget toy for every single conversation you have with anyone ever" will probably not help a neurotypical person much, yet that's something I'd advise to anyone with ADHD. You guys also probably don't need a physical list of things to do for fun, because you have brains good enough to remember. Ask me what I like to do in my spare time and I'll be like "hmmmm what even is time?".

I find Nir Eyal has tons of great advice that benefits both camps.
It exists, it's just that assuming partitions never happen isn't very practical.
It's funny that PG's "Blub Paradox"[1] is very close to your post, but harsher and stronger, but rarely draws much push-back when it comes up here, while your post is drawing flames like crazy.

I think PG's post is kinda shitty and is exactly the kind of thing you'd expect to see from someone who's very sure they've got things figured out, but aren't quite as far along their journey as they think they are, while yours is a simple correlational observation that probably has some truth to it (if there's an intellectually-challenging thing that's low-reward, probably the people involved will tend to be pretty smart, since they're just doing it as a hobby or for fun). Yet here we are, in the middle of a fire storm.

I think he's also dispensed exactly the advice you (basically) are, which is that you should choose some nerdy niche language if you want it to be easy to hire smart people cheaply, though I can't find it in a skim of that post and may be imagining it.

[1] http://www.paulgraham.com/avg.html
The Laravel from Scratch will still largely be applicable, the changes in 9 won't be breaking enough for you to be missing out a lot. The upgrades tend to be painless with a few small tweaks you might have to make (and those are usually described on the upgrade page).

If I were you, I'd start with Laravel 8.0 as you go through the Laracasts, and when done, go to the upgrade page of Laravel 9.0 and checkout the changes.
No, but if you don't have your half memorized and they take it from you, the other half is useless. This is more useful if you want to leave your crypto to your family if you die, provided that you make it easy for them to find your half if you're not around.
The OR folks would say it's the other way around.
python -m 'SimpleHTTPServer' 8080
From everything I have read, it doesn't go to Apple at all and the data isn't very accurate. This is a non-starter to me.
Sweet, he's campaigning again...
This is much more complicated than staking their reputation and traffic on to one line of code. Hashbang puts content retrieval into the client rather than a browser being a simple receiver (with js functionality applied, natch). This was a major architectural change for them and this whole fiasco points to a lack of foresight and, possibly, experience.

I'm guessing that sometime in the last year, someone at Gawker Consolidated Industries took the lead on doing this thing that Facebook and Twitter are doing and hey, if all the cool kids are doing it, why not us? Well, for one thing Gawker doesn't have the zillions of dollars to pay for the talent that FB and Twit have to ensure that the project is a success. Furthermore, given the money, whether Gawk would be able to detect and hire the talent required to make this change a success is left as an exercise for the reader. Even if they tried to cherry-pick technical talent from the companies hashbanging successfully, how many of us would jump from FB/Tw/Goog to...Gawker? I smell hubris.

I can't say the same thing wouldn't have happened if I personally tried to implement it, but I'm not Nick Denton or whoever the nepotistic minion is being protected here. The funny thing is that TC was ALL OVER Twitter when they were having problems, calling people out by name for decidedly smaller problems.

Lastly, I don't know if this would ever be possible in the business world, but it might be smart to (try to) put some kind of clawback or breakup provision in the kinds of agreements sites like Gawk have with its subsites where ownership reverts if the parent fails to thrive and traffic/usage falls below pre-agreement levels. I wouldn't be surprised if Gina Trapani wishes for something like that nowadays.
Someone needs to do a Geico parody with this line.

Host: Could switching to Geico save you 15% or more on car insurance?

Host: Can a question mark make an unsubstantiated rumour into journalism?

Scene showing boy on the street hawking newspapers with the headline "President is an alien?"

Cut to oval office, president drinking coffee. He reads the newspaper, spits coffee out

Cut to host

Host: Hm.. That wasn't a good example, was it.
http://hypebeast.com/2015/3/elon-musk-believes-that-itll-soo...
It's a shame there wasn't widespread support for XMPP's XEP-0045 (http://xmpp.org/extensions/xep-0045.html). It was the closest thing to IRC that I believe could've made it the new communication powerhouse in its place with its adoption by Google and Facebook, among others. IRC is great but there's no denying it's dying. It's shed to 60% of its userbase since 2003. It's not gaining new users.

Matrix (http://matrix.org/) looks pretty good, but I feel that it's trying to fill a niche that isn't there. A simple, open (in terms of channels / rooms), chat protocol that doesn't have a complex barrier to entry would work wonders.
Fair enough. Thanks for the perspective. just posting about this got me going building 'ninja' obstacles again in the garage, nothing crazy more borderline rock climbing similarity, but still something.
counterpoint: is there any reason not to use a stronger hash function?

Why leave something dangerous lying around when /probably/ nothing is going to go wrong... until someone picks it up and decides to do something with it that was unexpected, when better alternatives abound?
This doesn't have to be the case.

What if startups with high switching costs (DBMS, OS, pretty much anything else infrastructural) added a guarantee to their sales contracts?

For example, it could be that, if they get acquired, they'll open-source the technology, sell it to another for-profit entity that will maintain it, or provide a migration tool.

Even for something like FoundationDB, it'd hardly be any skin off Apple's back to have a few employees spend a few months ensuring that previous customers have some sort of support.
HeaderControlRevived has all of RefControl's features, but is able to manipulate more headers, plugging more potential privacy leaks.

https://addons.mozilla.org/firefox/addon/headercontrolrevive...
It's a marginal effect. The point isn't that you as an individual are going to put off buying all those things, the point is that buyers in aggregate will put off buying those things (or perhaps, immediately shift to a new, lower price that they are willing to pay for them).
I'd love to say this will make me drop whatsapp. But their lack of a web client didn't, neither did the terrible search or the invasion of privacy (not letting me turn off the blue double check mark). Sadly, whatsapp can do whatever they want and I'm stuck with it.

No whatsapp, no women. I really like women.
I'm confused about this. NZ has billboards. I'm not sure exactly what you're comparing with. Do companies elsewhere just "tag" their names indiscriminately? I haven't noticed any differences between the UK and NZ in this regard.
(process(line) for line in open('giantfile.txt') if line.lstrip()[0] != '#')

Is that line really using any new features in Python 3? The lazy evaluation there is in the file object and the generator expression, both of which have long been present in python2.
not to turn this into a debate about street safety, but it's rarely prosecuted unless there's another crime attached (being drunk/leaving the scene/etc) or some motive beyond "i wasn't paying attention".
This is all very true.

But in case of Riot I suppose it's best for you to read the documentation and see whether it does the job for you. I personally think the custom tag approach is a great way to go.
Question: do I read your compiler right, that any line starting with 'var', 'function' or 'this' is assumed to be javascript? So for instance:

<p>
How will riot.js compile
this line?
</p>

would fail?

[Don't mean to sound negative: I've been playing around with my own minimalist framework, so this is right up my alley. I'm reading the code to get a feel for how we've solved problems the same or differently, including the compile phase. Neat stuff and I'll write more when I have time to go over it in more depth.]
This didn't feel like much of an article. I'm super interested in hearing her responses to the interview questions, but the article just kind of stops!
Just tested the Mullvad VPN using IP2Proxy, a VPN detection service. It looks like Mozilla VPN could not bypass detection easily.
Brett Victor also has some interesting ideas about the symbology of math: http://worrydream.com/KillMath/
Github is a private company, and they have every right to remove misogynist content if they don't want to be associated with it.
http://playfic.com is a good archive of inform IFs.
From the ones that loaded, it looks like you've been hitting this bug:

https://bugzilla.mozilla.org/show_bug.cgi?id=605290

If you're on Windows, you could help by capturing a minidump, since it looks like they don't have much useful information at the moment:

https://developer.mozilla.org/Capturing_a_minidump
That would be impossible in the UK. Salary is paid directly into one's bank account and tax is deducted before it even gets there.
InvestmentWatch is just translating a story published in Die Zeit.
What does it use for the first-stage bootstrap, out of interest?
What have you done with Marc, and why is he never on Steam these days?
I call this experiment an exploration. What we explored in the past or might come to explore in our future wasn't, isn't, and won't be always wonderful. Sometimes it is horrendous and scares our inner animal but, at the end of the day, I (for one) am glad to see this territory charted.
I'd hope this should imply that journalists will become more aware of the benefits of using encryption and replicating documents (even centralized/cloud services would be OK, as long as the content is encrypted and they can't all be seized).

The big question for me is - why send such a strong signal to journalists? What is the big secret?

* That the fight on terrorism is ineffective because they have long been using techniques which evade all this surveillance

* That terrorism is no longer genuinely a significant threat thanks to human and signals intelligence, and thus the entire war is essentially a huge budget grab (and employment industry, and control/power mechanism)

* Simply that shutting down independent journalism is a goal

Or some combination of the above? I never imply wide conspiracies as I think they're genuinely too difficult to co-ordinate, but people/organizations do independently/implicitly collude by seeing each other's behaviours and reading the zeitgeist.
The source of the story is this, but it was in German:

http://translate.google.co.uk/translate?sl=de&tl=en&js=n&pre...
Be sure to watch the time timelapse video. Very ikea'ish
Monopolies can do a great deal of anticompetitive things without the help of the government. In the past antisocial pricing that was the primary concern. While these firms are different in that they do not charge users directly, their revenues are directly related to the size of their user base and other familiar tactics can be employed: For example, using their user-base to squeeze competitors in vertical industries, and employing defensive tactics that ensure direct competitors can never gain traction (see contacts spat).
This protest might not slow down security lines. These new scanners are pretty slow to begin with.

When I went through SFO recently it took 1-2 minutes to go through the scanner. The slowness seemed to be a combination of the instructions given to the flyer for positioning themselves inside the device, the slowness of the device itself, and the slack in the line.

In any case, I remember thinking that a pat-down might actually be quicker.
Yes I don't remember the lifetime of bulbs. Except for some pathological examples. So really the only thing we have is power usage which does correlate somewhat with light output.
Had he been made aware of the tracking device, like one is with an ankle monitoring bracelet, then sure, removal is cause for an arrest on theft, destruction of property, etc.

However, since he was not made aware of the device, he has no obligation to be compliant.

If the police were tapping someone's phone and they threw away the phone, for whatever reason, would they be in a similar situation?

If they avoided a human surveillance detail, would they be in a similar situation?

Likely no and no.

So while the police did things correctly, getting warrants, etc, the suspect was still entirely unaware of any need to comply.

The guy should walk.

Edit: addendum

If the device had been labeled "Property of {X} Police, do not remove", then they'd have a better case.

Same way the police are supposed to (but don't) announce themselves before kicking down your door.

You're not more important than the citizenry you serve.
This is the interesting statement to me:

> “But something is left on your car — even if you know it’s the police that are tracking you, you have an obligation to leave it there and let them track you?”

If you can compel someone to leave surveillance on private property, where does this precedent make a distinction. Could they leave surveillance cameras in your home and compel you to leave them there?
People say that censorship is wrong because good ideas should beat out bad ideas in the public discourse. Truthful and science based thought has won this battle. That's it, there isn't a rematch.

At the end of a sports contest, one side my be very unhappy with the result. Perhaps even violently so. But it doesn't change the outcome. This was contested and decided, even if there are people who still disagree