You could create the image as the largest size, and then save the image at different sizes that represent the average screen sizes for small, medium, and large devices, then use a switch statement to determine which one to load based on the screen size.
final Display myDisplay = getWindowManager().getDefaultDisplay();
int displayWidth = myDisplay.getWidth();
int displayHeight = myDisplay.getHeight();
This will tell you what your actual screen pixel size is. Even large images are tiny in PNG format a 1024x1024 image is less than 1.64 mb on average (depending on complexity). So if you do the average sizes you probably end up with 3-4 images at about 2mb total. Using the smallest image for the size of the screen will also speed up your app.