Use file.js from debian/missing-sources To build modernizr an additional source file is required (file.js) this file is added to missing-sources. It is a required build-dependency used when invoking the build script from upstream. . The patch is only here to use that file. That way there is no need to create a Debian package for it.
