Whitney Port’s husband told her ‘you’d be hotter with 10 to 15 more pounds’