Remember that the Scottish house gnomes, that are often portrayed as quite wee, are called "brownies." I wouldn't be surprised if Tolkien's nimble-fingered, brown-skinned Hobbits, "smaller than dwarves," were influenced by those.