The word on the street is that the Browns are not taking a QB (per Sirius NFL today). I am not sure if that means that the Browns do not like either QB enough to draft them, or the Rams are taking their guy (presumably Wentz) and they don't want Goff at #2 overall. My guess is the latter.
The word on the street is also that the Browns do not expect to win this year and will have a chance at the #1 overall pick next year and may take the top QB next year. The Browns are purportedly going the moneyball route and plan to build a stud team and then add the QB in a later draft.
Moreover they are rumored to be willing to trade Joe Thomas, because they do not believe that he will still be around when the team becomes competitive again. I think that is why you saw a mass exodous of players out of Cleveland this year, including starters.
I do not personally believe that Jerry will be trading up for Goff or Wentz. If it were Andrew Luck, probably would, but not these two. I think Jerry probably knows that Wentz is the Rams pick, knows that Cleveland won't take Goff, and neither will the Chargers. That drops Goff to our pick at #4.
I think Jerry wanted to see Goff for himself, because if Goff gets down to #4 and we pass on him, and he turns out to be the next big thing he will be crucified. This trip is more about Jerry doing his due diligence to not end up with a massive amount of egg on his face.
I think Jerry would love to trade back out of this draft slot. In some ways Goff would be a blessing and a curse for Jerry. The fans will let it slide if we never had a chance at a player, but if you pass on the next Randy Moss you have that p.r. rock around your neck for the next 10 years.