skysight-inc/HackerNews huggingface dataset:
I think the author is conflating several problems here. There are several ways logs can be used, and efficiency is a scale. For example, if I receive a bug report, I like to be able to locate the textual logs from when the incident occurred and actually just sit and read what was happening at the time. On the other hand, if I'm doing higher-level analysis such as what features do users use most, clearly it's more efficient to have some sort of structure format because you're interested in the logs in aggregate. The author makes it sound like they're advocating optimizing for the aggregate use case at the expense of other use cases. I think that the declaration that textual logs are terrible is an oversimplification of the considerations in play.

Also, if the author has a 5-node cluster producing 100Gbs of logs a day, the logs may also be too verbose or poorly organized. I work on a system that produces 100s of Gbs of logs a day but with proper organization they're perfectly manageable.

I think that a more nuanced solution is to log things that are useful to manual examination in text form, but high-frequency events that are not particularly useful could reasonably be logged elsewhere (e.g. a database or binary log that is asynchronously fed into a database).

In conclusion, as is frequently the case with engineering, I think the author oversimplifies the problem here and tries to present a one-size-fits-all solution instead of taking a more pragmatic solution. Textual logs are useful when meant for human consumption (debugging) and when they can be organized such that the logs of interest at any time are limited in size, and some other binary-based format is useful for aggregate higher-level analysis.
Does anyone know how big the hobbyist market is for electronic musicians? I've noticed a lot of my acquaintances talk about "making beats", including a lot of people I'd never suspect. It's made me think that group is larger than I would have thought.
Similar thing for me with my bike crash in 2012 - speed drops to zero, heart rate spikes, then drops whilst I sit around dazed.

https://www.strava.com/activities/22929472/analysis/17804/18...
It prints a single poster with a QR code.

But your comment leads to a different idea: a service that generates book spines. You can auto-alphabetise them or sort however you like. That "shelf" is then printed.
Any peg requires a trusted third party. It would be like tying gold certificate ownership to cryptocurrency tokens, like colored coins.

And when you have that trusted third party, why do you have independent miners? In other words, you get Ripple again rather than Bitcoin or an altcoin. You drop the decentralization.
YouTube to discontinue subscription collections 20/5/15
'Threes' vs. '2048' on Google Play
It looks awesome.

First thing that looks like candidate for contributions is a build system. I tried to build a package out of it and it is a collection of Makefiles and shell scripts that for sure can be used to build the thing on a developer's machine, but not useful outside that context.
Look at finance for more data.

I personally know many successful traders and managers who live very quiet, middle class lives despite having the means to do much more (usually because they get their kicks off business success, not consumption). Cf stereotype of the Swiss billionaire in jeans driving a beaten up Volvo. The head of a derivatives desk in the London HQ of a global bank used to drive a 10 year old hatchback to the office and lived in Zone 2 or 3 in the same house he bought as an immigrant with his first years' savings. Obviously, these guys don't appear in press releases. I would argue they are also relatively rare.

However, on the work hard play hard side, you can name literally hundreds of Gordon Gekko types like S. Cohen who bought Hirst's famous $8m stuffed shark or S. Schwarzman who likes to put his name on entire museum wings around the world. Some very driven people have more intense fun on the side and the only thing that matters to the VC/FOF is a. the possible ROIs under different scenarios and b. the probability of each happening; to calculate the NPV and therefore desirability of the investment. Some of the more extreme characters from this world are documented in "Richistan" [1] and "The $12m stuffed shark" [2]. The common trait amongst the "nouveau riche" is that they are intensely focused and good at their work, not letting their fun permeate.

If I had spare capital right now, I would happily take the other side of your trade; I'm pretty sure that spending behaviour (hard fun, tendency to consumerism, whatever you want to formalize it as), all else being equal, is not predictive of success, just as with race, gender and maybe even education or age (adjusted for experience).

As for the original subject, I think a lot of people who grew up well off or have had a few years to build some security do not realize how valuable those early marginal dollars are to someone without connections and a rich daddy. A "normal" person might well take 5 years to save the $100-200k necessary for a safe bootstrap; if they fail, they're back to the grind for another 5, delaying kids and life accordingly. It is perfectly rational for the founders to attempt to circumvent that if the market generously offers the opportunity, by taking out enough cash for a few trials should this one not work out.

[1] http://www.amazon.com/Richistan-Journey-Through-American-Wea...

[2] http://www.amazon.com/The-Million-Stuffed-Shark-Contemporary...
I am a big advocate of Ardour. But I really hope they get their act together and stop adding new features, but start making the release more stable. The last really stable and great version for me was the last of the 2.x releases.

They improved the looks but there was always something that didn't work quite right. IN the 3.x series Midi was introduced, but it crashed all the time (and I've updated every time there was a new release).

Now I am using 4.x and it is dog slow for big sessions (which I originally recorded and mixed in 2.x on a much lesser PC with no problems).

I do understand their arguments. I know that they want to release something for Windows, Mac and Linux to improve their customer base (greatly). But I really hope that Ardour solidifies and they start improving the quality that it comes back to the quality of the 2.x releases.
There's also the "python-pygments" package which provides awesome syntax highlighting. You can alias it to ccat too:

alias ccat='pygmentize -g'
I think his point was that querying a structured data is better than grepping unstructured text. SQL vs Regex, for example. I get the impression that he didn't state what solution to use but simply that binary/structured > text/unstructured. He even says that Journal isn't his ideal solution and never will be.
@dang, if you're listening, I think this may be the majority perception (it was certainly mine). At the risk of a giant, raging debate, it may be worth starting a long-running discussion on this amongst the HN community. Possibly with real voting and everything. Dare I suggest - quadratic voting?
> I don't have experience with binary logs. I think the fragility of binary logs is not baseless though. AFAIK there was (is?) a problem in systemd's journal where a local corruption of the log could cause a global unavailability of the logged data.

From my experience (I do not want to troll and presume you have not tried it), systemd starts off where it picked up when an old log is corrupted and stars a new one. There is a command line utility to verify the integrity of these files (on my Windows laptop at work, cannot check). Now, I am not sure the state of log file repair. I was told it is not possible. However, it seems this means the file is corrupted in a way it is not easily indexed. It is likely it is still readable. I wish I had seen this last time.

https://www.reddit.com/r/linux/comments/1y6q0l/systemds_bina...

Granted, I use Arch Linux on an old laptop. I had these corruptions routinely happen when I had disabled ACPI controls (I do not use the fancy WMs, I am back to Ratpoision) and completely, and I mean completely drained the battery until it came crashing to a halt). So, I am not surprised about these corruptions.

Anyone using systemd boxes in production who can comment on this? Flamewar or not, I would like to know more. I do not really care for it one way or the other. Parts I like, parts I do not.
Here it is http://www.hrw.org/news/2014/07/21/us-terrorism-prosecutions...
aphyr is a well respected expert in the matter. You can reproduce the test yourself https://github.com/aphyr/jepsen

Consider that if you have not experienced any issues yet it might say more about your network stability than aerospike. Of course you can chose to ignore it, but network partitions eventually do happen, and when it does I hope your data is not mission critical.
GitHub.com down in the UK?
Is GitHub.com down in the UK?
Functional Streams in Java 8
Cloud Computing Free Webinar
DEFCON 23 to host Internet of Things slaughterfest
On a slightly unrelated note, as a largely amateur Linux user: have people made systems that instead of grepping for info, use machine learning do detect normal patterns of a log file (like what type of events, similar, at different intervals) and report the anomalous output via email or report to an admin?

I was thinking this would be a cool area of research for me to try programming again, but it seems so daunting I am not sure where to start.
Been using this for a while http://www.vim.org/scripts/script.php?script_id=4325
Implicit in all of this is a belief that true happiness is found in some kind of luxurious aristocratic passivity of nothing but rest, relaxation and comfort. That's great, if it suits you, but some of us need a bit more stimulation in life.

The author also twists Adorno. Immediately before the quoted sentence ("the contraband of modes of behaviour proper in the domain of work… is being smuggled into the realm of free time"), Adorno says "free time must not resemble work in any way whatsoever, in order, presumably that one can work all the more effectively afterwards." Obviously work simulators try to very closely resemble work, and they don't try to hide this fact at all—no contraband smuggling here! That was written 50 years ago, maybe things have changed.
Better yet is to use multiple VPN services in nested chains, jumping among non-cooperating jurisdictions. It's easy to do, using pfSense VMs as VPN gateways.
Short of having a transpose verb, here is what I cape up with (using the arg text objext):

dia # 1. delete argument under caret
df # 2. delete separator (comma and space)
% # 3. move after argument (i.e to end of tuple)
p # 4. paste separator
"2p # 5. paste argument

I'm not doing this out of the desire of golfing but to analyse and point out that what vim lacks in this specific case is how to semantically do step 3 (ga/gA ?) and possibly step 2 (because what if there's no space? a "separator", like "surround", might be useful), upon which one could easily and semantically build a "ŧa" (transpose argument) sequence (which could also become ŧ2a, ŧ3a to swap with the second or third next argument, and capitalize the a to swap with the previous).

That said vim is still "only" a text editor, but it goes a long way at being a general purpose one with semantic operations.
> That's a lot more information than you could get from a binary log without any tools.

The environment I work in I am frequently looking at logs that other teams generate. If I needed to ramp up on their custom logging toolset just to perform simple queries I am going to give up and waste the the teams time by getting them to perform the queries for me.
I'm loving this, my head is reeling with the glint of possibilities

import js
js.globals.console.log('hi!'*5)
StoreDot announces: Within a year, we can charge an electric car in 5 minutes
Fortnum and Mason – Slack Deployments, Confident Delivery
The reward you get from a (well designed) game is both nearly immediate and directly related to the work you put into it. Additionally there is just enough randomness to create realism but critically not so much as to create the feeling of unfairness.

Compensation from work is much more distantly related to performance. A salaried or hourly person gets the same pay per time period regardless of being more productive than average or not.

Additionally that compensation is money which as at least one step removed from the actual reward.

And sometimes that reward is using the money to buy time off which is apparently a contradiction and requires complex understanding to justify the whole point of work. Games don't have profound contradictions in this category.

Also work compensation is sometime unfair paying inept or unproductive people who are good at office politics. Games obviously can't be unfair in this way.

Sometimes the rewards are immensely remote such as retirement. Game rewards often occur within seconds or at most hours.

Some rewards are just avoiding improbable miseries such as paying for an illness (if you have the misfortune to live in a society where this is a worry). Disasters in games are always no only unbelievable or impersonal but often humors eg minecraft's creeper or sim city's flood. No popular game has you grinding hard to save money just in case you become unemployable due to depression or cancer.
IN such scenario, 'near' realtime would work just fine. Just process the impressions through storm or spark and put the results in HBase (CP type store) or even PostgreSQL.
Attitudes and beliefs seem to have a tendency to be self-fulfilling to a point. So of course making work fun is going to be hopeless if you've made up your mind already that most of it can't be fun.
I have tested with the iOS Beta version while writing a 3D sports simulation game. I have missed these: a full object DB with a query language. Right now I use rucksack which serves my needs. Very productive to not have to deal with Core Data!!!

The other thing I miss is live edits, though using TCP sockets while having the device on the same network will work. But I don't know how to overcome iOS security restrictions which prevent compilation of new code.

Being able to write AI for a game and all game logic in CL is complete fun, as usual.
Is it useful to Android? Isn't ARM NEON different?
This. There is also a saying on a similar note: "It's OK to disappoint, it's not OK to surprise."
Used Teslas Are More About Saving You Time Than Money
50% off sale at O'Reilly to celebrate Day Against DRM
Apple Said to Be Without Key Music Deals Weeks Before Launch
I don't know of any systems that do this.

As an software developer, I generally use log levels to indicate severity in my logs. So grepping for ERROR should catch anything I had the foresight to log at the ERROR level.

Simple heuristics like the number of WARN level logs a minute may be useful.

Beyond that it sounds interesting. It may be hard to do in a general way, so focusing on Apache logs or something common may be a simpler task.
What's the best meeting scheduler service out there?
We're a marketplace that needs all stakeholders to get on calls. What's the best scheduler api that can be completely whitelabelled?
I'm sad that it didn't work out, but kudos to you for doing this. Behaving decently feels like it's becoming an increasingly rare attribute of doing business these days.

I'm curious if you feel it could have worked out differently if you'd flipped the approach on its head and instead of starting with investment and then the product, you bootstrapped custom radios and built the platform out from there when you had some traction?

I ask partially because I'm in a similar place at the moment with a product (http://mirobot.io) and considering different growth strategies.
Forget the Gov, he made fun of his own people by making a mockery of the situation in the press conference and then years later changed his position. He could have done something when he was in power.

Lets say there really was a a big craft. Maybe it belonged to the Soviets, who built that huge craft in secret. So it was a UFO but that does not mean automatically that it were Aliens.

I saw the 2 videos, those can be faked too. People believed the yeti video was real. People believe in the loch ness monster.

So many people claim that they were abducted by aliens, they talked to the aliens, well then next time just grab a small medical device, hide it somewhere maybe in the mouth and then once you are back on earth have a press conference and show the world.

> big craft in mid day over a big city

The videos I saw were taken at night. Can you please link to a video taken in daytime.

> but they still give us a sign that we are not alone.

They can just say hello using radio, we are listening for decades yet there is radio silence.
DHTMLX Many Tables Generator, a Gii Code Generator for Yii Framework 2
Delegation Is the Cornerstone of Civilization: Sharing in Sandstorm.io
Huh? Strange, i tried the search but nothing came up.
Doesn't have to be but usually is.
I've been told that this is actually just stolen Grooveshark livery slapped on an existing sketchy MP3 search engine, possible with bonus malware. It's late and I haven't tested it myself, though.
Seems to be back up!
I don't have any experience in using Excel for XML data myself, but it seems that these articles might help you import the data into Excel:

https://support.office.com/en-au/article/Map-XML-elements-to...

https://support.office.com/en-au/article/Import-XML-data-6ec...
Heh, well it is what I do for a living, plus in fairness the author was trying to make some general economic points. But I am not so sure about his argument because while individual movies vary a great deal, the manufacture of every film is pretty similar. Of course there are individual technical challenges of all scales, but almost all of those are worked out by specialists in pre-production.

To be honest, I think the author got stars in his eyes a little bit. You could call it the Hollywood model, and movies are fun to work on, but you could observe the same sort of short-term, multi-faceted teamwork on any construction project.
I'd be interested in a more reputable one as well. As in not injecting malware nilly-willy into my traffic. I'd appreciate if you could name some.

I think we are between a rock and a hard place here. I'd be willing to use a VPN in a non-cooperating country to evade state surveillance, but it is hard to make sure that you don't fall prey to non-state (or even maybe state) actors.
Indeed you print a single poster. When you'll add new books, your library will be automatically updated without printing a new poster.
You don;t roll all a Linux distro yourself; aside from the fact you use open source libraries, you need much less as it is only for running networked applications, which needs less stuff.
Learning to love BEM based CSS
How to quickly and effectively read other people’s code
The other conclusion is, always be hireable. I guess it’s hard to be 50 and pride yourself to work for senior-senior level salary when a 30 year old can easily do your job.

Hierarchies worked very well in the uni prof’s favour, but engineering companies tend to apply flatter structures. If there’s nothing that keeps the young folks competing, they will. So for us, engineers it may be a good idea to move to supervisory roles, a field with harder-to-aquire skills, or start teaching later on.

(+1 for small sample size and confirmation bias though. /re: @pixelscript)
I use the logwatch program for that. There is no machine learning, it's entirely manual with a large list of things it filters out, but the defaults are quite good.

It emails me any log entires it doesn't know about. I did have to add a large number of ssh lines that it should not bother me about, but other than that it works very well and I find it very useful.
Sometimes people don't comment because they don't have anything interesting/useful to add, but still found the article interesting and want it to be more visible, so they upvote it and move on.
Yeah, factoradic is awesome.
One of the initial challenges I see from an OPS perspective is that the most recent logs are often the most interesting. The latency of the logs being ingested into a DB would prevent me from using the DB. Generally, I find my self grepping logs on the prod servers.
Since PyPy is written in (R)Python, you can just run PyPy inside the resulting interpreter, for a 1000x slowdown.
How to Develop an iOS Video Recorder and Player on Swift in 15 Minutes
It may be fast, but I doubt it's very efficient...
https://news.ycombinator.com/item?id=9184779
It certainly has that feeling.

╰─$ whois grooveshark.io

Domain : grooveshark.io
Status : Live
Expiry : 2016-05-02

NS 1 : ian.ns.cloudflare.com
NS 2 : melissa.ns.cloudflare.com

Owner : Vita Tkach
Owner : Teatral&#39;na st. 21/8
Owner : Vinnytsia
Owner : Ukraine
Owner : UA

Check for 'grooveshark.ac' --- http://www.nic.ac/go/whois/grooveshark.ac
Check for 'grooveshark.sh' --- http://www.nic.sh/go/whois/grooveshark.sh
"you have 100Gb of logs a day"

Logs have lots of redundancy, so they compress quite nicely. So it is actually practical to grep those files since on disk they are not so large, and 100Gb of memory data is not a problem to grep.
Daimler launches self-driving trucks on public roads in Nevada
I'm so glad my brain does the syntax highlighting for me.
Do people here anticipate programming being their lifelong career, or do they in good faith, think there will be a switch later?

Personally, I've done this for 15 years and I keep doing contracting to pay the bills but really I'm pretty done with it.

What about you?
50% Off O'Reilly Ebooks and Video Training on Day Against DRM
Being a Python guy myself, the problem was never the lack of Python in the browser, it's always the lack of a Python ecosystem in the browser. If I'm going to use Python and awkwardly interface with JS, I might as well just use JS.

It makes me want to gouge my eyes out, but it's not really that hard to get productive in. CoffeeScript is even better, if you aren't averse to adding another dependency on top of everything else.
Post-Charlie Hebdo France votes through Internet surveillance law
I'm struggling to connect to certain websites, mainly GitHub and Slack. It's been like this for at least 2 hours.

Connecting via my phones internet is fine.
Defending A16z:Noam Scheiber mistakes a VC portfolio for his 401K
I wonder if the mocl people will chime in, as they are the other game in town.

https://wukix.com/mocl

Wish I knew enough Lisp to warrant buying any of these! But there is no way I would be dedicated to build an app in it.
Hi David,

That's a neat little explanation of how the system works underneath. Would you like to explain it in a quick little casual video on http://GlitchClub.com so we can see?
It doesn't have to be - but let's look at reality here. NIH syndrome is everywhere, we have millions of competing protocols and formats, everyone thinks they can build a better solution than someone else, etc.

I suppose that if there was a large push to universally log things in binary the possibility exists that sanity would prevail and we'd get one format that everyone agreed upon, but I don't see any reason that this would be the case when historically it basically never happens.

So, at least from my prediction of a future where binary logging is the norm, we have a half dozen or so competing primary formats, and then random edge cases where people have rolled their own, all with different tools needed to parse them.

Or we could stick with good ol' regular text files and if you want to make it binary or throw it in ELK/splunk or log4j or pipe it over netcat across an ISDN line to a server you hid with a solar panel and a satellite phone in Angkor Wat upon which you apply ROT13 and copy it to 5.25 floppy, you can do it on your own and inflict whatever madness you want while leaving me out of it.
Interview: From refugee, to teacher, to parent, now creator of UX-App
Why not use `less` instead of `cat`? Besides it is very easy to use `pygmentize` and `source-highlight` to get syntax highlighting result.