If using a raster image as the base for a pattern brush, Ai will pad the image with opaque white pixels. This makes it really hard - if not impossible - to use it on anything besides solid white background.

Note: This is NOT the anti-aliasing/"thin white line between segments" issue.

See screenshot.