We did something similar in Key West. We'd put a menhaden oil-soaked ragin our second livewell (with no bait in it). The rag would let a pretty steady stream of oil out of the overflow tube. Usually we used this when slow-trolling with live baits or if we were going to work a particular area for a long time ( trolling ballyhoo/ skirts @ 6-8 kts).