WASHINGTON — Surprising fossils dug up in Africa are creating messy kinks in the iconic straight line of human evolution from knuckle-dragging ape to briefcase-carrying man.

The new research — by famed paleontologist Meave Leakey in Kenya — shows the human family tree is more like a wayward bush with stubby branches, calling into question the evolution of our ancestors.

The old theory was that the first and oldest species in our family tree, Homo habilis, evolved into Homo erectus, which then became us, Homo sapiens. But those two earlier species lived side-by-side about 1.5 million years ago in parts of Kenya for at least half a million years, Ms. Leakey and colleagues report in a paper published in today’s issue of the journal Nature. In 2000, Ms. Leakey found an old H. erectus complete skull within walking distance of an upper jaw of the H. habilis, and both dated from the same general time period. That makes it unlikely that H. erectus evolved from H. habilis, researchers said.

It is the equivalent of finding that your grandmother and greatgrandmother were sisters rather than mother-daughter, said study co-author Fred Spoor, a professor of evolutionary anatomy at the University College in London.

The two species lived near each other but probably did not interact with each other, each having their own “ecological niche,” Mr. Spoor said. Homo habilis was likely more vegetarian, and Homo erectus ate some meat, he said. Like chimps and apes, “they’d just avoid each other, they don’t feel comfortable in each other’s company,” he said.

They have some still-undiscovered common ancestor that probably lived 2 million to 3 million years ago, a time that has not left much fossil record, Mr. Spoor said.

Overall what it paints for human evolution is a “chaotic kind of looking evolutionary tree rather than this heroic march that you see with the cartoons of an early ancestor evolving into some intermediate and eventually unto us,” Mr. Spoor said in a phone interview from a field office of the Koobi Fora Research Project in northern Kenya.

That old evolutionary cartoon, while popular with the general public, keeps getting proved wrong and too simple, said Bill Kimbel, who praised the latest findings. He is science director of the Institute of Human Origins at Arizona State University and was not involved in the research team. “The more we know, the more complex the story gets,” he said. Scientists used to think H. sapiens evolved from Neanderthals, he said, but now know that both species lived during the same time period and that we did not come from Neanderthals.

Now, a similar discovery applies further back in time.

Ms. Leakey’s team spent seven years analyzing the fossils before announcing their findings that it was time to redraw the family tree — and rethink other ideas about human evolutionary history, especially about our most immediate ancestor, H. erectus.

Because the H. erectus skull Ms. Leakey recovered was much smaller than others, scientists had to first prove that it was erectus, and not another species nor a genetic freak. The jaw, probably from an 18- or 19-year-old female, was adult and showed no signs of any type of malformations or genetic mutations, Mr. Spoor said. The scientists also know it is not H. habilis from several distinct features on the jaw.

That caused researchers to reexamine the 30 other erectus skulls they have and the dozens of partial fossils.

They realized that the females of that species are much smaller than the males — something different from modern man, but similar to other animals, said study co-author Susan Anton, a New York University anthropologist. Scientists had not looked carefully enough before to see that there was a distinct difference in males and females.

Difference in size between males and females seem to be related to monogamy, the researchers said. Primate species that have same-sized males and females, such as gibbons, tend to be more monogamous. Species that are not monogamous, such as gorillas and baboons, have much bigger males. This suggests that our ancestor H. erectus reproduced with multiple partners.