skysight-inc/HackerNews huggingface dataset:
Graeber has been pushing this for some time now - it is an interesting observation. In this particular article he does not even try to explain why this happens - but in other places he made silly theories about capitalist employers doing that on purpose to keep people from revolting - while omitting the simplest explanation - that it is the result of complexity of our organizations. People don't understand their jobs. Sometimes it means they do something useful but they don't understand why it is needed, other times they really do something useless - but nobody really knows which is which or what part of a job is useful.

Then there are company power plays which are counterproductive to the whole - but they are meaningful for the people who commandeer them.

And the biggest problem is that there is a positive feedback in that - after a few failures to rationalize the organizations people give up. The harder the organizations are to be understood the less people work on making them more rational.
Note that they're not talking about two separate props on separate shafts, they're talking about 2 props rotating in opposite directions on the same shaft. Many ships don't have a 1:1 ratio between propellors and engines anyway, if 2 separate shafts & props were faster they could do that easily. But counterrotating on the same shaft adds more critical moving parts in an already sensitive area.
Why use vi when you have ed.
FinTech takes root as mobile money interoperability goes live in Zimnabwe
Try a different class/teacher - there are a whole host of ways to approach/practice aikido, and taking care of health should always be paramount according to my line of teaching.

I am still not very flexible - but with lots of practice I am softer than most of the flexible people who join the dojo :)

Things like wrists/ankles/knees need time to (many months) to adapt/get conditioned.
Phishing with EV
I am a network engineer for a medium size company (I have worked for very large enterprises too) and there a a lot of opportunities for startups in network engineering.

1)Simple network automation platform that works for "My" custom environment, simply and effortlessly and also it should not break any existing network. (I don't mean like HP Network Automation)

2) Network diagram software - Seriously, any experienced network engineer will agree that this one needs a lot of disruption. Visio is very expensive and even then it is a pain to use. And Lucidchart or Cacoo or draw.io or other online tools too have their flaws/drawbacks.

3)Network monitoring tools - It is a pity that CA Spectrum, which is a ugly and non user-friendly tool, in my opinion, is among the most used network monitoring software. Network monitoring tools are bread and butter of NOC (Network Operation Center) teams.

4) Network devices configuration management tool and Change and topology visualization tool - Netbrain seemed promising in the start. But it seems to do too many things and has still room for improvement.

It is high time that more and more programmers should start building and contributing in network engineering field. There are numerous tools for each and every function. But there is lot of room for improvement in making those tools more elegant, easier to use and more reliable.

Yes, there is Software Defined Networking (SDN) where the vendors (Cisco, Silverpeak, Riverbed etc) themselves provide a nice visual dashboard. But the current "non-SDN" devices are going to stay for quite some time. And also why do we need to depend on one vendor and hence the Vendor provided dashboard? There will always be customers who would want vendor agnostic architecture and common tools to manage the infrastructure.

Note: A lot of the current tools (especially the ones I have mentioned above) do work very well and are used by large enterprises for a reason. But Tesla did disrupt the market of cars in its own way when reliable Toyotas and fast Ferraris already existed.
Was it the opportunities that are available in SV that make it possible to go on these adventures or something else like increased cash flow combined with more free time? Despite the higher salaries how are you coping with the high cost of living and high tax rates?
Windows 10 update bug locks machines running Chrome, Cortana and others
>There is a cost to such a heavy brain drain: governments spend billions subsidizing the cost of university education, while students who go on to work for foreign companies help fuel the economic growth of those countries

there's a pretty simple fix for that: have the government bill/charge you the subsidy when you're in university. it's not a student loan, and it doesn't appear on your credit report. you pay it back when you start working (every dollar you pay in taxes pays back $x that debt. you don't get charged intrest or are obligated to pay it as long as you stay in canada, but if you move to the US (or any other country), you start accumulating intrest and have to work out a payment plan.
The PLC/robotics/industrial automation space is often ten to twenty years behind in software best practices, with things like source control being completely alien to many vendors. Documentation can also be hard to come by, buried behind layers of paywalls and service agreements.

Of course, installations are usually expected to function for ten to twenty years at a minimum...an order of magnitude greater than anything your typical js-framework-of-the-day considers.
> Many (if not most) applications that process filenames do rely on those being valid text at least in some codepaths and they simply cannot work otherwise. The proper solution is to fail and let the user fix the problem.

Yep, that's what I meant. You need to do what is appropriate to the situation. Ignoring / warning are only two possible handling strategies. In many situations, straight-out failing is another valid one.

A file copy program should just not care and copy the darn thing. A text editor, basically the same, but maybe issue a warning.

Different tasks have different requirements, like the filename being text, the filename not containing spaces, etc. Given that these requirements are somewhat arbitrary, I think it's a fine choice to just not put any non-technical constraints in the guts.

There's an expression for it: Mechanism, not policy. You can always add policy on top, be it in the VFS layer, or as additional programs / classes of programs.

So many potential bugs would be easily fixed if the shell glob ('*') was more configurable.
I'd rather be exposed to generic advertising in the form of billboards, banners, and commercials, than head towards the dystopian future of The Minority Report in which you're constantly tracked, biometrics measured, and eyeballs scanned in order for advertisers to bombard you with personalized greetings and targeted ads that follow you relentlessly.

It's already too creepy that my smartphone has trained its autocorrect with words I've never texted before but can extrapolate from my digital footprint.
Totally agree. All the problems I listed are quite hard and will monetize slowly. Sales are really long; the company I am a part of had an all star founding team with a history of exits so they gots lot of funding which helped give them a cash cushion to deal with the long sales cycles.
If Canadian companies were willing to offer a competitive salary, maybe Canadian grads would stay. It doesn't even have to be 1:1 with the US, even 75% would be nice.

As it is, there is little incentive to stay here. I know a new grad who was faced with the choice of staying in Canada to earn $40-50k CAD per year starting, or heading to the US where he had a job offer with one of the big five for $120k USD plus signing bonus. Guess which option he chose?

Canadian tech companies love to complain about lack of talent, but they're not willing to pay for it, and they seem oblivious to the fact that we have a professional worker mobility agreement with our southern neighbors that makes it very easy to get a visa.

Something's gotta change.
Well, more than is practical to run, probably.
> that it is easy to parse correctly

While that's not exactly correct - CSV can be quite hard to parse if you want to cover each and every variation and edge case - for all practical intents and purposes that statement is true in my opinion.

CSV is something of a lowest common denominator, a compromise between well-defined, structured data and portability / accessibility.
If you use Rust.
https://crates.io/crates/rusqlite
It's because of the pay and type of opportunities.

You either take below market rate (like myself) or you work in something like one of the 300 ad-tech or we'll-build-your-website/app dev mills (more often than not it's both).

There are a limited number of opportunities for truly interesting or innovative work if you don't want to work for "we're changing the world by creating the next uber/airbnb/cryptocurrency/coupon app!"

There are some seriously good and interesting companies here, but many exist out of the popular eye and/or usually located in the suburbs. (at least around Toronto)

But mainly I suspect it's the pay and career trajectory. Get a gig at FAANG? You can write your ticket after that. Work at a major Canadian company? You won't get a call back from other Canadian companies at a pay cut...
No, that particular case was a completely justified use of lethal force.

Police we're being directly fired upon. Should officers not fire back when they are fired upon?
Only when it has to. Nobody likes change.

Apple's going to be here for a while, they can afford the salaries people are demanding to be here.

The trend is already clear and accelerating for smaller firms. No startups can afford to hire here on a 500k seed. You'd be paying 200k/head all-in, you can't even run a 4-person company 18 months on that.

The bigcos will be slow and conservative like they are with everything. But change is already very obviously underway.
Ask HN: Is a React Native like approach to desktop apps better than Electron?
Free to play, expensive to love: 'Fortnite' changes video game business
You work on a personal project in the other 6 hours instead of browsing HN. Or at least watch videos on youtube about various technologies.
I agree that SQLite-as-file-format is a great idea. But CSV still has some significant advantages for certain use cases. One big one that I don't think others have mentioned is that CSVs are human readable with any old text editor. That's a big help when working with unfamiliar datasets, debugging, etc.
Which city in Canada are you studying in? Have you spent some time in SV?
Google rolls out new policies for U.S. election ads
In the WP case there was essentially a monopoly (Luxotica). As a monopoly they had built in additional profit and limitations that gave WP more room to work. It was definitely a broken market. Traditional competitors like Oakley were killed by Luxotica stores simply refusing to carry their brands and then buying the company when the stock sank. The "disruptive" delivery was needed to be a viable competitor.
I enjoyed it, but the reveal was a little disappointing.
Build a side project. It can be non-profit.
Developers are undervalued quite a bit in most places outside SV. (And maybe overvalued a bit in SV.)

I agree about your main point though. It's time to put up (salaries in this case) or shut up.
Even 100% tax rate is not enough to pay for a meaningful UBI, even in the US. You will have to take major budget cuts somewhere.

Suppose we tax Forbes 500 at 100% level and the companies too. That would provide about 2 billion USD a year. Divided by population it will be less than $2k a person yearly.

Suppose you tax top 10%, I'd expect that to double this number. Still way not enough.
And we're not even close to military budget.
Kids in US can't read analog clock
SQLite has no type safety on its fields; CSV is just text. You can create an integer field and save the value "wenc" in a SQLite record without it complaining, something it calls "dynamic typing."
I'm wondering how that salary difference really is when comparing the cost of living of many Canadian cities vs Silicon Valley, the taxation rate and the social services provided (universal healthcare, etc).
A bug in #GandCrab #ransomware V3 accidentally locks systems running #Windows 7
Parquet is a great columnar format, and Avro is great for schema evolution. But they're not that easy to work with directly. To this day there isn't a decent Parquet viewer to do adhoc data viewing.

SQLite on the other hand has a lightweight SQL REPL that can be invoked from the command line.

Spark can work with SQLite via JDBC, though obviously it isn't as native as Parquet. Between SQLite and Parquet, I might pick Parquet under most circumstances.

But it seems to me SQLite ought to at least be a better option than CSV for Spark jobs (less work needed to do type inference, predicate pushdowns are trivial, etc.)
Maybe part of the plan, it's difficult to enforce hand luggage limitations at airports without adding extra checks, but if you exceed 10kg that overweight suitcase is going to make some drag on carpet. Small nudges, similarly how BA cabin crew are instructed to never help anyone put their luggage in the overhead bin unless they have a suitable reason.
> CSV's biggest strength is that it is easy to parse correctly

(goes on to say a bunch of applications don't parse it correctly; lets add mssql to the pile)
Django app to redirect spam bots to '10 hours of' videos
I had a very similar experience once when I worked for the government. I wanted my small desk pointed a different direction, so I rotated it.

A few hours later my supervisor and a union rep showed up fuming. They have people for moving things, why was I trying to take their jobs?!
US salaries are much higher, the tech industry is booming in the states, and it's very simple to apply for a visa or start a consulting company to work remotely from home.

If you're a student graduating out of a Canadian college/university and are looking for ways to advance your career (while making a lot more money on the side), what's not to love about moving or working remote?
Amazon has the entire company dogfooding Chime[0]. Pretty happy with it. Really good for video/phone conferences. Half-decent imitation of slack for chatting.

You can join a concall via phone number + pin, from your desktop, or from the mobile app. The mobile app will even let you view screenshares or video conf.

[0]https://aws.amazon.com/chime/
Kind of lost me when they gave military jobs as an example. By this logic, it is "pointless" for organisms to have immune systems, since if other organisms didn't cause infection it wouldn't be necessary. Maybe, but that's not the way the world is (or was, or likely will be anytime soon). It's a definition of "pointless" so remote from the real world as to seem...pointless.
OpenLDAP uses LMDB now, one of the fastest and reliable key/value stores around, which they wrote precisely because berkeleydb sucked.
I swear I've looked for that setting before. Thanks!
Miserable winters + low pay = brain drain.
CSV is fine for tabular data which is by far the biggest use case. When the data gets even slightly more complicated, people are not importing and exporting it all that much.
Coming from BC (west coast) I believe the taxation rate would work out about the same.
We (Cloudflare and APNIC) knew exactly what we were getting in to. We knew this was the only way that we'd be able to reclaim the space to be usable. And, in about a month, we've gone from 1.1.1.1 being routable by only 92% of networks to 98.7% of networks — and climbing. Don't accept that you can't change the status quo.
Whether you're left or right is not classified by what you claim yourself to be, but how you act. And wanting to be nice to animals doesn't eradicate your stance on wanting to suppress diversity.

I also recommend: https://en.wikipedia.org/wiki/Right-wing_politics
Career change is often best one variable at a time. For example, change company size but stay in the same industry. Double jumps are generally harder.

Perhaps, focus on startups that reduce the number of change variables. For example, startups focused on satisfying the needs of enterprise IT customers should value your inside knowledge of the pain points.

Keep looking - the right thing will be out there. (For example, my company, Turbot, is actively seeking remote employees with enterprise experience and a pent up hunger to get stuff done.)
> High-end condos don't generate jobs. They provide housing for the jobs that are already here and the new ones that are being created every day.

You completely missed the point. You are simply not taking into account the service industry jobs that arise to serve the new "high-end condo" residents. Baristas and teachers need BMR housing.

> a millionaire... who unfortunately is very good at couching his own financial and personal interests in the veneer of progressive language in order to co-opt groups... into working against their constituents' long-term self-interest.

Exactly the same criticism could be made of tech-millionare-backed, largely white YIMBY groups. The difference is minority and low-income housing activists are broadly opposed to YIMBY policies. Your only explanation is that they are victims of a rich white puppetmaster.

You should try listening to them better. You completely misrepresented their position earlier; even those that supported the passage of SB 827 did so after substantial amendments that arose from protesting the YIMBY-backed original bill.
> That other airports don't implement this system continues to astonish me.

For the US airports where TSA directly provides airport security, this is probably mission-related. The TSA checkpoint’s mission is to make sure unauthorized people and objects don't get into the sterile section of the airport. Additional protocols to prevent theft are off mission, so resources aren't going to be devoted to identifying, establishing, and operating them.
Typical collective action problem. Everybody wants to move here but nobody wants to house them.

At some point the business community just has to pull a Bezos and be like, OK guys, fine, you don't want us here, we're packing up, bye. Then see what happens when all those pension and infrastructure payments come due. Hilarity will ensue.
I told them it had a blue cover and a white front.
Edmonton.

I worked in MTV for 4 months, 4 months in Seattle, and I'm leaving on Monday to SV again for the summer.
While there's truth in the paradigm you advance, it's not anywhere near as binary or direct as you might me suggesting.

There's a ton of leakage and noise at most stages in biological pathways. Biology actually spends enormous amounts of effort to reduce the noise and leakage, but it's really hard to eliminate entirely.

Lets take the danger temp gene you use as an example. In bacteria that's mostly true, but even there what if we're low on nutrients? Or low on a particular nutrient? Or what if we start producing too much protein which is aggregating because the concentration is too high? Each cell is balancing all these concerns simultaneously, so even very simple biological circuits work/don't work in unexpected ways. What the OP is suggesting is that you're always concurrent with a huge number of different things going on that are far less isolated from your "process" than is traditionally the case in CS.

I agree that concurrency, mutability, scope, all that is relevant, but I think the OP's point that we don't have the theory on how those will apply in a biological context is correct.

Edit: for those interested, some papers on biological noise and the efforts cells use to reduce it:

https://arxiv.org/pdf/1610.00820.pdf
https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4006352/
https://www.cell.com/molecular-cell/abstract/S1097-2765(12)0...
Yes they may be identified but that doesn't mean they will be apprehended if they are already safely back in their home country.
Want to stem the tide? Pay more. I miss Toronto but I won't go back unless my visa situation falls apart.
Most future goons will be robots too. For both practical and political reasons (dead soldiers are not so cool).
Deployment at Facebook: https://code.facebook.com/posts/270314900139291/rapid-releas...
> Excel's CSV parsing isn't the greatest, but does a surprisingly decent job considering how ill-defined CSV is.

No, it really doesn't. Save this as a CSV, open it in Excel, hit save, and then review the raw CSV:

"1000000000012345", "Hello",

"2000000000067890", "World",

Here's what Excel (O365) does to it for me:

1E+15, Hello,

2E+15, World,

That data is now permanently lost. And this corruption occurs for almost all EAN/UPCs. There are many ways to get around this in Excel, but the default experience is data corruption and has been for most of my lifetime. It is a terrible application for CSV. If they followed the standard every column would be what it is: Text.

> XML isn't really on anyone's radar in the big data world.

But is a central theme in the business to business back-end systems world. I'm talking about ordering, invoicing, remittances, hospital records, hospital billing, and so on. No clue what "big data" is, we deal with billions of transactions a year, but that's likely not what you're referring to.
Only solution: take a pay cut as a CEO and offer a higher salary to prospective engineers. Don't want to do that? Don't complain.
Not op but The New York Times has some interesting layout options available to their writers and editors. You can see a small sampling of it in https://open.nytimes.com/building-a-text-editor-for-a-digita... which is written by one of the developers of their new news room text editor.
I follow what you're getting at, but don't you think a large part of that is due to your own attitudes/perception? It's not like there aren't people in Canada who are doing exciting things like sky diving, let alone driving stick.
Work QA at a game company. Work 18 hour shifts for $15 per hour. That will set you on the path.
Walmart Beats Amazon in $15B Flipkart Battle
Have you seen WordPress' new Gutenberg editor that they'e working on?
> To allow others to impl the data store they want and to avoid having to write blog posts like these.

That's not a good enough reason. Those others need to first justify what the specific benefits of switching would be. I have a strong feeling that a lot of these people don't actually know why this change should be made beyond "I heard that SQLite 'isn't a real DB' but I don't know what that means". The customer is not always right; sometimes people making feature requests need to be told "No".

> It's not that much real work to quickly pull out an iface on a stable system

Maybe we've worked on different things, but this has not been my experience. IME, replacing a DBMS is agony, and adding an abstraction layer so you can use multiple DBMS's is agony exponentially magnified. Some of that is due to bad choices you made in the original design, but a lot of it is just because these systems will never behave identically, no matter what promises they make about SQL standards. Don't forget, also, that when you target multiple DBMS's, you're locking yourself into hitting the lowest common denominator of the intersection between their feature sets. You might end up making performance worse because you can no longer use DBMS-specific optimizations!

But this is all immaterial: no matter how much or how little work it is, it's all unnecessary work. If there's no benefit to switching, why do any work at all, especially when it has all the downsides I mentioned above.

> Often, what you end up learning about your system when you do this minimal work (again, nothing big) is that you screwed up and buried SQL and string concatenation and a bunch of other hard-to-review pieces....

I agree! So go through the app and fix those and then see if you still need to swap out the storage layer (which is actually what the author is recommending). Don't just do it because it's faddish before you've even established that it would actually add value.
But cycling affects largest human muscles, which work more intensively..