skysight-inc/HackerNews huggingface dataset:
When I first found notebooks I was amazed at their utility. The ability to quickly display algorithms and processes to a wider (potentially layman) audience is amazing.

To be able to have a scratchpad and play around with techniques while keeping a sort-of record is also amazing.

I see it like I see excel, it's a fantastic tool for data exploration and some visualisation. It's not something that should be used in any final workflow or production system.

Like excel, it can be badly mis-used but they unlock ways of working that simply weren't possible before it.

The criticisms about hidden state are fair, I think it would be better if previous step data was more explicitly wrapped in the following cells so you could choose to use the "wrapped package" of the previous data or choose to use a re-evaluating version.

I think it works best when most cells have few side-effects, even if that means repeating previous calculations.
If they know they'll enjoy it, they'll do it and not ask for validation before.
I have built a two level house, more conventional brick veneer. It is a massive amount of work even when you hire various trades, etc.

Don't know about all concrete houses. Wet concrete is extremely heavy and you need to know what you are doing when it comes to formwork, etc. You would also need concrete pump to get the stuff to the upper floor.

You will most certainly need the services of an architect and structural engineer. The level of detail you need to get building approvals, etc is substantial. You might even need town planner, geotech and environmental consultant reports as well.
Ironic this pops up today when a colleague has this scenario happen...

BA: We found this duplicate field error in our database, do you know about this.

DS: I told you about this 2 years ago.

BA: Oh so you have a script to produce all the duplicate records?

DS: No I did this 2 years ago I don't know what version of Python or any of the libraries I used for the notebook.

In my experience a lot of data scientists like this work alone on business problems - if they were in a more collaborative environment they'd probably run into the problems that Joel is discussing a lot more and be more open to build libraries.
Dashboard App colors palette
These Cultural Treasures Are Made of Plastic. Now They’re Falling Apart
Absolutely on the money here. I finished it for Desktop and was thinking of making it Mobile friendly, so I started reading on it and realized I designed myself into a corner because of support for touch interfaces. Learned that lesson. The simple solution would have been 4 buttons at the bottom of the page, but just wasn't as nice playing on mobile that way.
You can't blame the article for being filler when clearly it serves more purposes than just informing you about the name of the condition. Another purpose of the article is to ask for help from the public, which is the goal the first 60% serves.
I am sad to hear that this is still going on. I got my PhD 25 years ago and it was the norm then. Postgrads were used as IT support as well as teaching assistants and anything else going.

At least I knew this when I started. And it motivated me to get finished in 3 years.

Someone did give me the advice in this article before I started. Which was good. I wasn't in it for the money. It was the freedom to work on things that interested me that mattered.

What no-one told me later, when I started a post-doc, was that the chances of getting a full-time academic job were close to zero... now that did feel like 3 years wasted.
I have no doubt a government is to blame for the financial stagnation or decline. Thou not clear on how they are responsible for having companies produce massive profits and keeping wages low.
BTW, how to report the violation?
No, Clojure is not as elegant (or flexible) as Common Lisp, not even close. Also, how can Clojure be highly practical when it ties you to the JVM? When it forces its worldview on state down your throat? When it prematurely optimizes with concepts like STM?

Common Lisp is all about choices and flexibility. Do you want pattern matching? You can get it but it's not shoved down your throat. Same for STM. Same for immutable data structures. Same for Java interop.

On the other hand, Clojure is lacking fundamental features of Common Lisp that are extremely powerful: conditions & restarts, programmable debugger, programmable reader, programmable compiler through compiler macros, dumping images & native code compilation not to mention advanced code analysis and optimization capabilities.
Maps are not just roads. POIS, transit rails, pedi paths all play a role,esp in cities. And OSM does well with path data but it's POI data is disappointing compared to Google. Transit stations are in the data but no info about what lines serve them. For eateries or stores, hours, menu focus, parking data is often part of Google POIs but is missing from OSM.

All great reasons this data is not present, but that does limit OSM usage in a wide group of cases.

The data that is present, however, is wonderful.
If you're using a small subset why on earth is it the right language? I had the misfortune to try to mentor a new quant who felt they had to write C++ "for speed" . But refused to use the STL as they were going to use a subset. So they wrote Fortran-like C++, array as the only data structure, bad lookup algorithms and leaked like a sieve.

Things are in the language for a reason - if you've got the issue then you use the feature.

I hardly ever recommend C++ these days as it's not worth the slower dev time. There are a few cases where run-time really does trump everything else and it's still appropriate.

In that case the code will be templated to within an inch of its life, because that's how to write real C++.
Your Privates. An easy-to-read Aussie privacy policy
Syncdocs [0] is also pretty good for merging and tracking changes between Word and Google Docs. It also has a feature with real-time collaboration between Google Docs and Word.

[0] https://www.syncdocs.com/
Most or many German phds are intended to be 3 years long, while in the US many people do 5 years, but it's basically a master's and phd combined. For instance a German phd will almost always be only research, no classes. So really it's not that different, master's and phdare just rolled into one in the US.
>My understanding of IOCP is that the model requires the following: if you want to, say, receive data on a socket, you supply the IOCP w/ a buffer/length. After some data has been received, the buffer and the amount received are returned to you.

And then you have a language with GC and you want a async IO, and your runtime becomes so messy with IOCP support, so you just use poll on windows, as many languages do. kqueue is fine, but messy and incomprehensible, and I don't see how is it fundamentally better than epoll with ET.
> You declined to do so, but that's your decision.

This kind of patronizing attitude is unnecessary and silly. The vast majority of users of any software product are only interested in being just that: users. And that's totally okay. No need for passive-aggressive shaming.
It's not redundant. A "source-to-source" compiler isn't a "source-to-machine code" compiler
> get as much out of blog posts following happenings

Curious, what are some of the best blog posts/sites to follow?
I dunno... I was a child when I noticed that toilet paper is different from other paper, in that it degrades pretty rapidly when wet. Feces also obviously doesn't hold its shape very well. That seems fairly straightforward and 'logical', and my instinct wouldn't be to flush anything that doesn't have a decent chance of breaking up in water. Again, most kids would know that latex and rubbery things don't break up in water.

I've never looked up the way the plumbing system works and what it can handle, and was never taught much about it, but it was pretty easy to come to the subconscious conclusion that flushing is (generally speaking) for liquids, poop, and TP.

I will say that I wouldn't expect anyone to know that (as described in the article) a product explicitly marketed as "flushable" wouldn't be good for the water system. But that's a separate topic IMO: a systemic failure in providing inaccurate information vs making assumptions that don't err on the side of caution.
You might be able to tweak it 45 minutes though by living at the edge of the time zone. But you have to figure out if you’re staying up with the sun or your work schedule.

If you stay up until the sun is nearly up then the eastern edge means the sun is up longer before you have to be at work. But if it’s N hours after you get home, then you’ll see more daylight on the western edge which might be more healthy for you.

For me I don’t want to move if the sun isn’t up yet. I need to move farther south so my winters aren’t as rough.
The alternatives suggested in this thread are all like: oh, X does A, Y does B, Z does C, etc.

But people mostly don't want three or four different mapping apps to cover their use cases. Having it in one app is a better user experience.
Swift or Objective-C with Metal, so far so good. Console-quality graphics on phones and tablets.
> If you load a React frontend, it'll, by default, deploy a service worker.

What?

> That is how the web works.

The web 'experience' has stopped being about fetching static documents in a request/response fashion long ago. Consumers demand rich apps and interactivity, and it appears they're having it their way.
It's europe, there's not that much debt.
During a power crisis caused by a high tension cable breakdown Auckland depended on ship borne power. I'm pretty sure it was GE gas turbines. There is a well understood model for mobile power, I don't see why this model can't work and guy lots of use cases. Nuclear why not?

The loss of competence in nuclear engineering worldwide worries me. Do we need to start sending engineering grads to Brazil? Britain outsourced it's coming plants to China didn't it?
Having to use `\textbf{...}` is impetus enough for writing in Markdown instead.
Yes it is. Real software engineers don't care about trends or hypes. RoR gets the job done and that's all they care.
> That is how the web works.

good luck trying to convince google of that. they are shaping the web just the way they want it. push notifications? nobody ever except the marketing apartment thought that was a good idea to add to anything. if we try making everything on the web like mobile apps we're gonna get garbage features like this and false expectations on what the web should be like.
Why & how WoW succeeded, in my opinion:

User Interface Customization using Lua.

Also, I think WoW indirectly taught a lot of developers about Taint checking ( https://en.wikipedia.org/wiki/Taint_checking ) - something I still feel extremely bitter about missing from Javascript, replacing it with "Signed Script Policy" in retrospective seems like a bad idea, to the point where people re-invented it after it got removed, but still no community maintained implementation exists:

https://github.com/phvogt/NoMoXSS (The paper for this has 579+3 citations [+3 because there exists a separate citation network due to Google Scholar being, well, Google Scholar: https://scholar.google.com/scholar?cites=4323801493645906635]: https://scholar.google.com/scholar?cites=9547351675563063950. Yet I don't see this kind of feature in any mainline javascript implementation.)

https://github.com/idkwim/jsTaint (Different project, it seems)
> Isn't trust a massive problem? If I'm getting into a car without a driver, I have to trust that the system is smart enough to get me to my destination safely.

Car manufacturers have decades of experience in shifting danger from inside to outside. Passengers are not the ones we need to worry about.
>'Priceless' 300-year-old coin that men had to buy to avoid Peter the Great's 'Beard Tax'

How on earth does paying the tax to receive the token proving you have paid your tax amount to "avoiding Peter the Great's 'Beard Tax'"?

Maybe modern-day tax dodgers should try this clever scheme too. Avoiding tax by paying the tax they are trying to avoid.
I work in a lot of Django shops and my Ruby is nowhere near as good as my Python but I'll pick Rails every time if I'm working on a side project. Why? Because the development velocity when using it is unparalleled. I can have an MVP up orders of magnitude quicker than I can with Django/Flask/Twisted. You're absolutely right on the Admin interface and auth, but auth is a gem install away [1] and Django's admin won't fit my requirements more often than it helps; I can seldom justify exposing it to end users and it's a hideous undertaking to extend it meaningfully (I gather this is one of the reasons it is a bit of a laggard compared with the rest of the framework. We only got mobile support out the box in 2.0 for example [2]).

Other reasons I enjoy Rails:

- Scaffolds allow me to have CRUD support for any model I want with one command (combined with auth, I have Django's admin, more or less)

- JSON views without a third party library (surely this is pretty standard for a web framework in 2018 in most cases?)

Other reasons I don't enjoy Django so much:

- I can't think of an eloquent way to phrase this but Rails values my time. With Django I'm doing menial minutiae like creating a directory for my app's templates before it'll serve a page. Why? I know 'magic' is anathema to the Python community but context switches like this shouldn't be there when I'm trying to get an app up and running at speed

- I feel like it's stewardship is bordering on begrudging: Why are websockets (and JSON for that matter, but I've touched on that) not present in a 'kitchen-sink' web framework? I'm not sure why we're worrying about master/slave DB terminology [3] when there are axiomatically more pressing technical and adoption-related issues at hand.

Django is a fine web framework, and perhaps the best-in-breed for Python, but it feels miles behind where it should be at this point and I'm not really sure why.

[1] - https://github.com/plataformatec/devise

[2] - https://docs.djangoproject.com/en/2.1/releases/2.0/#mobile-f...

[3] - https://github.com/django/django/pull/2692
I thought about this one:

https://xkcd.com/456/
I disagree. The memes give me memory cues when I think about the talk later. I have a visual memory so maybe this is why?

Also they are lighthearted and fun and life is short so why not have some fun even when being serious?
I'm planning to use RAID5 in an upcoming N/DAS build. Though it's not a server-level setup, so I'm using SnapRAID+MFS which can tolerate more than 1 drive failure in this case, atleast without loosing the entire array.

RAID5 definitely has a purpose, notable small arrays where RAID6 would be wasting space or if you have nodes to failover too (ie, you have 3 nodes, run each with raid 5, if one goes belly up during a rebuild you still have 2 left and you can reprovision the third).

RAID6 would likely be at the limit of most modern implementations so you'd have to jump to (n,n-3) RAIDs or higher. Of course there is always RAID1(0) if you like 50% storage efficiency.
> What?

https://github.com/facebook/create-react-app/issues/2398

> Consumers demand rich apps and interactivity

They really don't. That's an assumption without data.

EDIT: see gov.uk. It works quite well without being fancy.
Getting to Know the All-Time Favorite MySQL Open Source Database
I think they meant “dynamically typed”.
Because installing the MySQL Installer and the MySQL workbench requires so many prerequisites, a lot of people won't even consider it.
What I learned from Flipkart
I had a coworker who ended up working an hour more on average than everybody else because he would show up at 6 and try to leave at 3. But shit usually breaks around 3 and that’s plenty of time for people to complain about how you’re never around when we need you.

I tried to convince him to either work out or do a side project in the morning, or take at least an hour lunch every day. I wish I could remember what he ended up doing but it might have been “work somewhere else”.
Hmm, agreed. But before you share a notebook, restart kernel and rerun all cells, fix all errors, and then share... Solves many of his gripes.

I use notebooks all the time, but I put repetitive code in a module, try do put all functions at the start etc. It is much easier to share data science experiments, but indeed notebooks can be used and presented in horrible ways.

So... now we write a presentation on how we can horribly abuse VSCode + an iPython console and call it even?
Arguably it's not a pure ML problem where you can just learn what to do from human drivers. You need to know what the alternatives are, which actions are potentially dangerous etc. So you run your "beta" system and record when the safety driver takes over. Then you improve the system from that and drive some more. These iterations will take a lot of time, and you can't just scale it with more engineers (see The Mythical Man Month etc).
> Consumers demand rich apps and interactivity, and it appears they're having it their way.

no consumer ever demanded the web to be like an app. this is marketing baloney crap. stop treating humans browsing the web as targets for advertisement and consumerism.
Shoes of Prey has stopped taking orders
How technology is bringing stability to the oil industry
Although I am a huge fan of Jupyter, Joel made some serious points there.
First, we should think about embedding used package versions in our notebook to enhance usability.
If you are focusing on words, you are missing the big picture. 'Guts feelings' are what you get when your brain process a butt load of informations in a fuzzy way. This includes subtle smells, colors, moves, timing, shapes, sounds, chain of events and how they interact with each others.

Words can be a tiny part of it, but usually gut feelings are about all those things you can't process as easily with rational thinking and so rely on a different, less precise and more general, method of analyzing. This does not play well with language, which is very accurate and precise, very intellectual.

It's why we can easily walk, but have a hard time describing how we walk.

A commenter on HN talked about the book "The inner game of tennis" not so long ago. I highly recommend it to get a gentle introduction to this part of us. Especially on this site, where a lot of us are geeks who are more used to leverage their rational thinking than their feelings.

Last year, many commenters talked about meditation. While I do recommend the practice, starting from the sport point of view is way easier to swallow and make a better starting point for people with strong affinity with precision and step by step logic.
Ask HN: How to find a good LinkedIn/CV writer?
I'm looking for a US based resume writer that has understanding and foucs in tech. What is the best place to find one? All the freelance/gigs sites writers looks scammy to me.
Building data pipelines with Make
Please, please involve definition lists. They are useful. They were present on the first webpage[1].

[1]: http://info.cern.ch/hypertext/WWW/TheProject.html
> "...the reason for democratic representation in general is that humans have a hard time giving real weight to others' priorities. They'll help them when they can, but certainly not if it involves real costs and trade-offs to their own, obviously far more important interests..."

I apologise if this draws away from the primary point of your comment, but I thought this was quite poignant. It's a sentiment that manages to convey my intuition about the motivation behind hard-line anti-socialist groups, and also has the added bonus of explaining why "feel-good" one-off donation/volunteering stories in the media are so popular. People like to pat themselves on the back for helping others, as long as they aren't inconvenienced. People like to praise social constructs that help others, as long as they don't encourage constructs that inconvenience themselves.
I have worked in a few academic institutes (and still know many friends in the same places). 5 years seems to be the norm, with some people taking up to 7.
A collection of sysadmin test questions and answers for interviews/exams
"> Problem is, the whole damn thing is so complicated that we cannot know anything really definitive about it.

You can say the same things about human societies and nature."

You can, but the thing is, we already know a lot about how that works. We've evolved into it over millions of years. We have no idea about this new stuff.

You want to talk about about small groups of 100-150 or so people work together to accomplish something? I've got hundreds of books, stories, history, archaeology. We have the wisdom of the ages. You want to talk about how 20 thousand semi-intelligent agents interact with billions? We have nothing aside from endless optimism and the fun of making stuff. (Doesn't make it bad. It means we should grow the hell up and be a bit reticent about what we're mucking around with. Make smaller mistakes more quickly would be my advice.)
In e.g. Sweden (that has this PhD system), the max student debt allowed (unless you go to a private lender which is more or less unheard of) is for 5 years full time studies. Meaning you already "maxed out" your student debt before starting tour PhD.
Why would you be sure of that? As it happens, I have a TV and watch it every day.

In fact, research (in the UK) suggests that people who use phones less are more likely to watch TV than people who use them a lot.

It wasn't my intention to "boast" that I don't use a phone much. The post I responded to was making a point based on the assumption that "we" have our phones on 100% of the time. I was just trying to point out that there are people in that "we" for which that is not true.
You can use the Haskell-based static site generator Hakyll with Pandoc to create the best best blogging experience imho.

An example of how easy this is and the styles I use for my personal blog:
https://curious.observer
https://github.com/davnn/curiousobserver