Binarity is favored over alternatives by general scientific logic, therefor to the extent that a linguist is concerned with scientific logic, that is the expcted tendency. However the specific details depend on the particular application. The general principle is Occam’s Razor, specifically the principle that given an unnecessary proposition, the theory without the unnecessary proposition is to be chosen (xref the classical Aristotelian, Aquinian and Newtonian statements).
However, the concrete application of this logic varies substantially in linguistic theory. In the case of phonological features (which preceded generative theory by many years), the initial position was that there is a small set of orthogonal properties which are present or not, which can define all human language sounds. The Jakobsonian branch introduced a specific notion of plus and minus values for features, which is the underlying premise adopted by genertive grammarians. This is analogous to computer representations of positive integers from 0 to 65535, that each integer can be represented as a unique configuration of 1 and 0 bits within a field of 16 bits. The computer guys could have tried for a base 3 representation of numerals where the values yes, no and meh yield integers from 0 to 59049 within a field of 10 bits. The two theories are similar, but where the binary theory posits the bit-entities ‘0, 1’, the ternary theory posits the bit-entities ‘0, 1, 2’, making the binary theory a simpler subset of the ternary theory. This prejudices the scientist in favor of the binary theory.
Further however, straight binary theory in phonology soon was actually replaced with ternary theory (the names were “+, –, 0”) then later a virtually unbounded set of values (+,–,u,m,0,1,2,3,4…). The propositional complexity of the theory changed by expanding the range of possible values associated with a given feature. This is in clear violation of Occam’s Razor, which does not allow expansion of entities unless it is shown to be necessary.
Phonological theory later (in the mid 80’s) rediscovered Trubetzkovian privativity, so there has been a retreat in this expansion of entities. Part of this retraction was the removal of u, m and integers as values, because phonologists rejected various aspects of the SPE theory of computation and representation. The elimination of integers (or reals) stems from the rejection of the SPE premise that there is no phonetic component to grammar, where is where integer values might be of some unique use. Therefore, rather than positing that there are two values for every features, we would now say that a given feature is present or not present. In binary theory, you have three concepts: feature, attribute, and value. In privative theory, you have only one concept: feature. This is an instance of intensional reasoning, that is, focusing on the logic of the theory rather than the class of things that can cranked out with a particular theory. Linguistics in the 70’s-90’s was more highly focused in extensional thinking, in terms of classes of outputs, but current thinking is more focused on the fundamental nuts and bolts of the theory. So in fact privative theory is not binary theory. (I should point out that neither binary nor privative theory has carried the day in contemporary phonology, instead agnosticism rules).
A touch of extensional reasoning likewise underlies the syntactic claim of binary branching. It is well known that N-ary trees allow uncomputably many ways of arranging 15 words into a single tree, therefore a child cannot possibly learn a language that allows sentences that are at least 15 words long (i.e. all languages), because there are too many hypotheses to entertain and reject. The added premise that all branching is binary vastly reduces the acquisition problem, and imposing a single direction of branching carries you even further. If you only allow binary branching, you complicate the theory by positing that there is a limit on the number of branches allowed, but your theory of upper bounds is the simplest possible (0 and 1). Some complication is necessary (for reasons of acquisition), binary branching is the logically-simplest complication.
Complexity is defined at the level of the theory itself, and cannot be intuited from the superficial behavior of the system. To understand complexity arguments, you have to know what propositions define theory A versus theory B. The problem is that people tend to bypass the step of explicitly stating the propositions that constitute A vs B, therefore there is a mistaken tendency to think of complexity in terms of reified “steps” in a pseudo-computation. If it is simpler to smash {a} + {b} + {c} together in a single more-powerful step, rather than two steps, imagine how much simpler it would be to smash
{a}+{b}+{c}+{d}+{e}+{f}+{g} into {a, b, c, d, e, f, g}, and yet even simpler to just start with {a, b, c, d, e, f, g} and forego the smashing-together step entirely.