Leptospirosis is a zoonotic bacterial disease that affects more than one million people worldwide each year. Human infection is acquired through direct or indirect contact with the urine of an infected animal. A wide range of animals including rodents and livestock may shed Leptospira bacteria and act as a source of infection for people. In the Kilimanjaro Region of northern Tanzania, leptospirosis is an important cause of acute febrile illness, yet relatively little is known about animal hosts of Leptospira infection in this area. The roles of rodents and ruminant livestock in the epidemiology of leptospirosis were evaluated through two linked studies. A cross-sectional study of peri-domestic rodents performed in two districts with a high reported incidence of human leptospirosis found no evidence of Leptospira infection among rodent species trapped in and around randomly selected households. In contrast, pathogenic Leptospira infection was detected in 7.08% cattle (n = 452 [5.1–9.8%]), 1.20% goats (n = 167 [0.3–4.3%]) and 1.12% sheep (n = 89 [0.1–60.0%]) sampled in local slaughterhouses. Four Leptospira genotypes were detected in livestock. Two distinct clades of L. borgpetersenii were identified in cattle as well as a clade of novel secY sequences that showed only 95% identity to known Leptospira sequences. Identical L. kirschneri sequences were obtained from qPCR-positive kidney samples from cattle, sheep and goats. These results indicate that ruminant livestock are important hosts of Leptospira in northern Tanzania. Infected livestock may act as a source of Leptospira infection for people. Additional work is needed to understand the role of livestock in the maintenance and transmission of Leptospira infection in this region and to examine linkages between human and livestock infections.