x64 instruction decoder doesn't understand 0x40 REX prefix

RESOLVED FIXED in mozilla36

Status

()

RESOLVED FIXED
4 years ago
4 years ago

People

(Reporter: dmajor, Assigned: dmajor)

Tracking

36 Branch
mozilla36
x86_64
Windows 7
Points:
---

Firefox Tracking Flags

(Not tracked)

Details

Attachments

(1 attachment)

(Assignee)

Description

4 years ago
On the Windows 10 preview I found this:
00007ffd`28772e90 4053            push    rbx

WindowsDllDetourPatcher::CreateTrampoline fails because it doesn't understand the first byte.

0x40 is a REX prefix with none of the REX bits set. Before |push rbx| it is unnecessary, but we should accept it anyway.
(Assignee)

Comment 1

4 years ago
Created attachment 8527453 [details] [diff] [review]
Support 0x40 REX

With my debugger's assembler I tested that all the instructions that we support for 0x41 also work with 0x40.
Assignee: nobody → dmajor
Attachment #8527453 - Flags: review?(m_kato)
Comment on attachment 8527453 [details] [diff] [review]
Support 0x40 REX

Review of attachment 8527453 [details] [diff] [review]:
-----------------------------------------------------------------

thanks!
Attachment #8527453 - Flags: review?(m_kato) → review+
https://hg.mozilla.org/mozilla-central/rev/b5023fc55b4c
Status: NEW → RESOLVED
Last Resolved: 4 years ago
Resolution: --- → FIXED
Target Milestone: --- → mozilla36
You need to log in before you can comment on or make changes to this bug.