It looks pretty much normal to me. Your carpet occupies almost half image area, so it is expected to have significant impact on render times. One thing you can try is to reduce polycont of carpet. Unless you plan to put a camera inside a carpet, you can simplify fibres model a lot, like a ten times and you still couldn't tell a difference.