As cargo peaks, port stakeholders worry tariffs may lead to a trough