skysight-inc/HackerNews huggingface dataset:
More to the point: Text logs are just as structured as binary logs, but they have the additional property of not being as opaque and, therefore, being immediately usable with more preexisting, well-tested, well-known tooling.
We are open to recommendations, help and overall insight from expert contributors in security. As many people on this thread have pointed out, it is a big and complex world..
Межкомнатные двери авилон
When I shop, I look at the quantity. If my chocolate has 90 grams instead of 100, I'll immediately put it back and look for another brand - because it's too hard for me to compute how much I would get swindled of.
Running Django manage.py commands from anywhere
Binary logs may be fine for you, but don't force it on us!

This is really the important point here. For small systems, grep works fine. The number of people administering small systems is much greater than the number of people administering large systems. The systemd controversy has caused people to fear that change they don't want will be imposed on them and their objections insultingly dismissed: a consequence of incredibly bad social "change management" by its proponents.

They are therefore deploying pre-emptive rhetorical covering fire against the day when greppable logs will be removed from the popular Linux distributions. Plain text is the lingua franca; binary formats bind you to their tools with a particular set of design choices, bugs and disadvantages. My adhoc log grepping workflow has a different set of bugs and disadvantages, but they're mine.
I would hope this is the same asker (or someone interested in the HN response to the question):

https://news.ycombinator.com/item?id=9496813

IMO, risking everything for the big payout and good odds of ending up in a good position at one of the top big techs would have been the reason to quietly select Zenefits or similar. Uber is unlikely to cash out and unlikely to offer much equity to the fair weather friends that are knocking on its door now.
It works for as many users as you can fit around it, from any angle, including above.

It's a electromechanical device, so getting it to holodeck size may be challenging.
Agreed. Logs are for when everything and anything is broken. They aren't supposed to be pretty or highly functional, they are just meant as a starting point for gathering data.
I did a very similar thing with my group of young volunteer firefighters (also in Germany). We launched a total mass of 500 grams in order to avoid having to get a special permit for this (note: this will change in Germany quite soon!)

We also used a Raspberry Pi Model A+, but recorded 720p video. We powered it using a 9V block battery and regulated the voltage to 5V. Worked like a charm!

Here's some videos and pics: http://www.florianerzons.de/yffzhab/

Edit:

Completely forgot. I also wrote some blog posts for anyone asking themselves how this can be done:

http://mactunes.de/posts/2015/2/25/yffzhab---taking-videos-a...
http://mactunes.de/posts/2015/3/2/yffzhab---powering-electro...
http://mactunes.de/posts/2015/4/6/yffzhab---bill-of-material...
You beat me to it, so I'll just add that figlet in combination with the inestimable cowsay (http://en.wikipedia.org/wiki/Cowsay) produces excellent results.
We call this reprehensible "Rent-Seeking", and it is one of the larger problems with modern laissez-faire capitalism.

http://en.wikipedia.org/wiki/Rent-seeking
To what extent OPEC is functioning and able to effectively control the oil price is very much debatable today, especially since shale oil.
It's hardly the uptime of someone who's struggling with kernel panics and random crashes. Last power down was when I embarked on a trip. The previous one was a system update. In fact, I never saw a kernel panic with this machine.
a colleague sent me a link to "tactic 14." after reviewing the citations i'm skeptical of the rest. it appears the author misunderstood some research he cited.

the thesis for tactic 14 is:

> Anchoring not only works for prices, but it also works for any number, regardless whether that number is a price.

the SSN example demonstrates anchoring based on price (not just any high number). the results of this experiment would have likely been the same if people rolled dice.

and the only experiment [#4 of 5 from adaval and monroe (2002)] which tested "irrelevant dimensions (e.g. weights)" vis-à-vis priming with high/low prices seems to have been poorly designed and produced questionable results. (it should be noted the test methods were also sufficiently different than the UX illustrated in the article.)

so based on the cited research there's nothing that leads me to believe it makes sense to use "any high number" to make my price look better. and if i've understood adaval and monroe (2002) correctly this could actually create a contrast effect (and diminish value perception).

additionally, the suggestion in the article -- "join 2,387 happy customers" -- could also be an example of social proof, making it difficult to ascertain the cause of behavioral change. (was it any high number, or all those happy customers? or both?)

and lastly/separately, why base pricing strategy on the offline behaviors of a bunch of starving students looking for extra credit? it's 2015. where's the shopping cart data?
Another ASCII art weather (forecast) utility, but in Go: https://github.com/schachmat/wego
RHINEHART, VoiceRT, how NSA converted spoken words into text
Problem solving & creativity. Making something new out of nothing.

The practical / mental challenge & then reward of building something useful, expanding my understanding of the world, how things work.

Other practical hobbies such as woodwork, have similar satisfaction in there being an end result to look at and use, but although I enjoy them a lot, there's less mental learning, and so less mental satisfaction at the end (for me).

Other artistic hobbies such as creative writing have often as much mental effort, in trying to figure out how to explain a concept in exciting language, so that it ends up being interesting to read, but then doesn't usually result in a practical 'thing' that I can then use frequently. You write, you publish, it's done. With code, I often get to then use the result for (hopefully) years afterwards. And can improve upon it later.

I love seeing the whole structure of a project, made up of small parts and all fitting together.

I work full time in a non-profit org. as a programmer and A/V engineer. So a lot of my code is specifically related to our video production, events management, etc. So I get to see the rest of my team (and people at events) using my products. That's very satisfying.

I love learning. and so learning haskell, c, lisp, go, rust, etc. as well as improving my main working languages (Python & javascript) is fascinating. The ability to read one blog post, suddenly 'get' a concept, and feel as if my whole mind is bigger and my ability to think is clearer and mental model of things I can do is exponentially bigger is so exciting.
Data Science Weekly Newsletter – Issue #76
This new generation of startups really needs to learn some fundamental business and engineering methods, like the value of always having a second source[1].

I cannot understand why some people think it is a sane idea to run a business where the your main product or service depends entirely on a single point of failure; doubly so when that single point of failure is controlled entirely by someone else that can cut you off without consequences.

[1] http://en.wikipedia.org/wiki/Second_source
@zoidb I agree, there could be multiple answers. I'm eager to know if there are any other frameworks that you suggest I can use. My intention is to have the voting and badge system of SO and the easy collaboration system of Wikipedia (which uses MediaWiki framework). Instead of the MediaWiki framework I like TiddlyWiki but it'll take a long time for me to integrate voting and badges system into it. May be I'll do that once this idea of mnemonic building is validated. So this was the quickest safe path (tried and tested framework) I could follow to validate my idea. Do you have any suggestions?
There seems to be a sbt plugin by the original creator that has not been updated since last year: https://github.com/hcoles/sbt-pit

Does anyone know if the current version of pit already works well with scala?
Whilst down, here's the google cache: http://webcache.googleusercontent.com/search?q=cache:i4t2gyG...
> Who would have guessed this would work?

A lot of people? The carbon has to end up somewhere. I don't see this as surprising at all, any more than it's surprising that if you, a human, eat a lot of arsenic, you'll add some of it to your hair. Growing hair and growing silk are not fundamentally different activities.
This not investing - it is gambling.
What after the fail of a startup?
Simple really. Rational nations led by rational leaders have had access to nuclear weapons. Both sides had one goal, to live, which means never really wanting to use them

the danger this day and age is that are some very irrational powers, possibly including leaders and the countries they represent, that, well, don't think the same.

Even India and Pakistan get along because neither side is governed by fanatical leadership. Likely the real danger comes from one of the more intolerant sects of Islam
Generally believed by whom?

The classic case on this topic is http://en.wikipedia.org/wiki/United_States_v._Progressive,_I.... And nobody knows what the court would have ruled because once the blueprints for the hydrogen bomb were reprinted widely, the government decided that there was no point in continuing the case.
How is this Camouflaged? The plane stands out pretty well.
When you're threatened with jail time and million dollar fines, your first thought isn't "yeah, screw it, I'll appeal". Most rational people will just play it safe and comply.
Knowing that, authorities can use it to suppress anything inconvenient that comes close to some broad definition of "dangerous" information.
RTK GPS is quite common for levelling applications. It's closer to 25mm in the vertical when a local (~10km) base station is used. Lasers are used but have line-of-sight and atmospheric distortion issues.

This [1] is a good overview of how RTK works.

[1] http://www.novatel.com/an-introduction-to-gnss/chapter-4-adv...
It feels increasingly like there are too many programmers for too few programming jobs.

Here in Denmark many companies are so picky that they only hire people with a MSc in CS/CE. Many of them have also outsourced HR to recruiting companies which is an absolute disaster for people who are self-taught or only have a BSc.
> text logs are a universal format

Uh, I don't know what world you live in but I'd like the address because mine sucks in comparison.

Text logs are definitely not a "universal format". Easily accessible, sure. Human readable most of the time? Okay. Universal? Ten times nope.

Give you an example: uwsgi logs don't even have timestamps, and contain whatever crap the program's stdout outputs, so you often end up with three different types of your "universal format" in there. I'm not giving this example because it's contrived, but because I was dealing with it the very moment I read your comment.
No, but if you spend a lot of times on OpenGL software user fora, you'll see that Intel is far and away the least headache-inducing graphics option on Linux and the only realistic option on the BSDs.
Grepping logs is terrible. Reverse engineering a binary format so you can diagnose why you are is worse. Logs should be handled as text until they reach their long term storage... then whatever helps analyze and query is fine...
This isn't something I'd be willing to try, for a black widow web...
Ask HN: Google/FB engineers, Do you like Mercurial?
All the Google and Facebook engineers who are currently using Mercurial, I want to hear from them how they feel about Mercurial over Git. If they leave GooG or FB, will they still use Mercurial?
You're nitpicking. Shale's an external disturbance. It says nothing about the inherent stability of cartels in general or OPEC in particular.
Grepping logs is terrible. Reverse engineering a binary format so you can diagnose why you are down/crashing/losing data is far worse. Logs should be handled as text until they reach their long term storage... then whatever helps analyze and query is fine...
Not to mention 99.9% of the searches one does of a log file isn't really that complex. Heck, I'm willing to wager that 90% + of my searches over the last 20 years have been in log files from a particular day.

That's the thing about having simple text log files - the cognitive load required to pull data out of them, often into a format that can then be manipulated by another tool (awk, being one of the more well known), is so low that you can perform them without a context switch.

If you have a problem, you can reach into the log files, pull out the data you need, possibly massage/sum/count particular records with awk, all without missing a beat.

This is particularly important for sysadmins who may be managing dozens of different applications and subsystems. Text files pull all of them together.

But, and here is the most important thing that people need to realize - for scenarios in which complex searching is required, by all means move it into a binary format - that just makes sense if you really need to do so.

The argument isn't all text instead of binary, it is at least text and then use binary where it makes sense.
Why not an election? If voters still vote for both parties, then there isn't really controversy, it's just the people you know who share your ideas.
The first self-driving big rig licensed to operate in the US
"The number of people administering small systems is much greater than the number of people administering large systems"

Do you have any evidence for this statement? Because it sounds all kinds of wrong.
I wonder, why are nuclear weapons so hard to build? is it possible that in a near future an average terrorist is able to build one?
United States dumps two bombs with no reason in Japan and you are saying that only rational leaders and rational nations have access to nuclear weapons?

We are not in a nuclear war because US makes more profit based in the fear than in the use of the bombs. Don't play this "intolerant" game.
Freightliner Inspiration Truck Unveiled at Hoover Dam
Nah, it's one of the larger problems in any known economic system (including in the form of corruption).
I don't know. It seems like another risk to build in. They had the chance to make a big app and potentially be acquired by Facebook or someone. They didn't win enough people over to put the screws to Twitter, so they lost.
Interesting describing ASCII art as 'beautiful'. You can tell this isn't Designer News :P
The internet’s own boy: the story of Aaron Swartz [video]
But at least you have a fighting chance. What if that exact same data was dumped into a binary file, that you did not know how to decode?

Originally, you had a problem - the data wasn't formatted in a manner that you could parse cleanly.

Now, you have a new problem - not only is the data not formatted properly, it's now in some opaque binary file.

Saying that there are poorly formatted text files isn't a hit against text files, it's a hit against poor formatting. The exact same problem exists if the file is in binary form, and not formatted properly.
It's not that simple at all. Several times systems and procedures were set up to trigger nuclear escalation, and even though those sytems and procedures indicating making an attack, the person who had the final say in doing so chose not to. Thsy didn't make that choice necessarily knowing about game theory or Nash equilibriums, they weren't following deliberately concieved national strategic policy. They just made a judgement call.
I think your motivation makes (some) sense. But there are real issues with getting from here to there, and I'm not sure you are addressing them.

How do nail manicurest take part in a system they can't afford?

Traditional welfare systems do this by redistribution. In the US that seems to be a dirty word, but I think it's a perfectly valuable approach.

Another possibility is the Union-retirement-plan model, where a group of workers has sufficient market power to force employers to subsidise the welfare of group members who aren't working.

Neither of these seem to be your approach.

So how does it work? The key question is how do you stop non group members joining your group?
Namespacing Twitter Bootstrap
WolfCoders SecurityCam 1.7 Key Plus Crack Full Download
I guess that's part of why such a large part of our thinking is subconscious parallel processing: as a workaround for this technical limitation.
Genetic similarity. I guess charity should begin with people of the same race as me.
That's far less dangerous than you might think. True, people are far more likely to look ar a drone than a random object, but targeting a 2mm wide target from a drone is a hard problem. Especially when you consider how dangerous fairly small drones can be. IMO, as long as your taking about something less dangerous than a car surpassing information seems excessive.
"But what we find totally unacceptable is log files being shoved into binary repositories as the primary storage location"

The way I read his article, he's not really opposed to additionally keeping your logs around as text.
But you make a good point of using text as the primary storage location, since you can always easily feed it to some binary system for further analysis.

Would the best practice then be to keep your logs around as (compressed) text, but additionally feed it to your log analysis system of choice for greater querying capabilities?
But where does your line get drawn and who gets to decide what "too dangerous" is? This is just ripe for abuse. There are many ideas that are considered a threat to the current regime of a country and in many cases there is the suppression of those ideas that threaten the status quo.

Also, I think it may be a mistake for you to think that you are the first and only person to have come up with most of your "dangerous" ideas. Open conversations about potential threat vectors is a much better proposition than trying to sweep it all under a rug, hoping some "bad actor" never arrives at that same idea.
Like you, I also deal with the kinda weird uwsgi logs. I feel like "universal format" probably didn't mean the format of all the lines in all the logs is the same - though your definition is probably more accurate.

Despite that, I can be pretty sure when I walk in to a foreign system there will be nginx logs, just where I expect them, almost certainly in the format I'm used to. And even if the format differs, it's not much of a problem. Binary logs, big problem.
Why ecommerce will morph into local commerce in India
Thx a lot Zuikaku! Hahaha, that's minimal :) Will check it out more later.
From the perspective of a monopolized, unregulated etc. market, it is free of competition, free from regulation, etc.

off-topic: what's the preposition to use with free?
I'm glad the author says "one starts to wonder if it really is plain dumb luck". Another way to answer the question:

> Why Hasn’t the World Been Destroyed in a Nuclear War Yet?

Because in an alternative universe where there was a nuclear war, this has already happened, and there was no one left to ask the question. Or if there was, they certainly had better things to do.

See also: most questions and statements about real estate in 2007, or on Long Term Capital Management and their scientifically proven methods before their demise.

Survivorship bias is a PITA.

EDIT: Someone doesn't understand probability. Possible worlds is the only rigorous way of reasoning about counterfactuals.
Honestly - I agree about the ELK stack side - piping all your logs into ES / Logstash is a great idea. (Or Splunk / Greylog / Logentries)

If you run any sort of distributed system, this is vital. And while that counts as binary logs, I would argue that on the local boxes it should stay text.

I would agree, if you are running any sort of complex queries on your data - go to logstash, and do it there - it much nicer than regexes.

If on the other hand, you just want to see how a development environment is getting on, or to troubleshoot a known bad component tail'ing to | grep (or just tail'ing depending on the verbosity of your logs) is fine.

I don't have to remember some weird incantation to see the local logs, worry about corruption etc.

One problem I will point out with the setup described is syslon-ng can be blocking. If the user is disconnected from the central logstash, and their local one dies, as soon as the FIFO queue in syslog-ng fills, good luck writing to /dev/log , which means things like 'sudo' and 'login' have .... issues.

Instead, if you have text files being written out, and something like beaver collecting them and sending them to logstash, you have the best of both worlds.
This is fascinating stuff - now they just need to feed genetically modified spider-goats graphene and see what happens!

http://www.bbc.co.uk/news/science-environment-16554357

http://en.wikipedia.org/wiki/BioSteel
Take this philosophy to an extreme and you end up with a dedicated data format and tooling/APIs to access the data for every subsystem, not just logging. Essentially, this is Windows.

The downside to this is that now you don't have a set of global tools which can easily operate across these separate datasets without writing code against an API. I hear PowerShell tackles this; I don't know how well. The general principle though harms velocity at just getting something simple done, to the benefit of being able to do extremely complex things more easily. See Event Viewer for a good example of this.

Logs don't exist in isolation. I want to use generally global tooling to access and manipulate everything. I don't want to have to write (non-shell) code, recall a logging-specific API or to have to take the extra step of converting my logs back to the text domain in order to manipulate data from them against text files I have exported from elsewhere for a one-off job. An example might be if I have a bunch of mbox files and need to process them against log files that have message IDs in them. I could have an API to read the emails, and an API to read the logs, or I could just use textutils because I know an exact, validating regexp is not necessary and log format injection would have no consequence in this particular task.

I do see the benefits of having logs be better structured data, but I also see downsides of taking plain text logs away. Claiming that there are no downsides, and therefore no trade-off to be made, is futile. It's like playing whack-a-mole, because nobody is capable of covering every single use case.
They are hard to build because once the chain raction starts in the nuclear material, the resulting reaction tends to break up and disperse the nuclear material before the chain reaction progresses very far. It's called a fizzle. Fission bombs are designed with a wrap-around concave shaped charge of conventional explosive around the nuclear material. This is detonated as the critical mass of nuclear material is slammed together, and the compression wave from the conventional explosion holds the fissioning mass of nuclear material together long enough for the chain reaction explosion to complete. The engineering for this and the precise timing and controll of the detonation sequence is extremely hard.
There are a bunch of factors. There are both correlated and uncorrelated errors that you need to correct. The main source of correlated error is ionospheric distortion, which will affect the two units mostly equally. At the low end (cheap cell phone GPS receivers), the measurement errors unique to each device will tend to dominate.

If you wanted to experiment, there's no need to do it online. If you log the output of the two receivers you can align the timestamps and try different ways of post-processing.
Three Best Time Management Apps That Can Help Your Business