Garden Design (used to be magazine, now, sadly, just a website) has a series of recommended day trips for garden tours. The one for Portland, created with the help of JJ De Sousa, includes trips to Leach Botanical, Crystal Springs Botanical Garden, and (new to me) the Rogerson Clematis Garden.