EasyList

Entries in the Category “Known issues”

Advertisers' and tracking companies' websites

written by Michael, on Jul 1, 2011 6:44:00 PM.

Problem:

Some websites relating to advertisers and tracking companies (predominantly the former) do not function correctly when EasyList or EasyPrivacy are enabled respectively.

Affects:
  • Google AdSense

  • Adcash

  • Other domains are also likely to be affected and will be listed as they are reported.

Cause:

EasyList is intended to remove adverts, just as EasyPrivacy is intended to remove tracking. The subscriptions often include general rules to remove the unwanted content and also selectively block domains that exclusively serve such items. However, as these filters are often and unsurprisingly activated by websites belonging to advertisers and tracking companies, some parts of the domain may fail to function correctly.

Solution:

Subscription policy is that it is not worthwhile to resolve issues on domains belonging to advertisers and tracking companies, beyond requiring that filters blocking an entire domain only apply on third-party websites, as we believe that very few users regularly visit such websites. However, it is possible to disable Adblock Plus on the affected website using the option in the menu activated by clicking on the icon in the browser.

Cashback schemes and EasyPrivacy

written by Michael, on Jun 9, 2011 6:35:46 PM.

Problem:

Some cashback systems do not function correctly when EasyPrivacy is enabled.

Affects:
Cause:

Cashback websites work by either setting a third party cookie or directing people to a special address to inform the shopping website that the user is eligible for a discount. Shopping websites then need to be able to view the information to identify the user and reduce the item cost if applicable. However, EasyPrivacy is designed to prevent such details being collected; the shopping website therefore lacks the information to suggest that a special offer should be applied and charges to full price instead of the discounted rate.

Solution:

I have previously recommended, and would still advocate, that Adblock Plus should be disabled on important websites and when shopping. This will ensure that subscriptions do not interfere with the purchasing of goods and will therefore prevent issues from arising with cashback schemes. However, regardless of whether or not advert blocking software is installed, I would always recommend that you confirm the price of an item before paying.

Giorgio Maone, NoScript.net and FlashGot.net

written by Michael, on Apr 25, 2011 6:46:00 PM.

Problem:

Some adverts are not blocked by EasyList on Giorgio Maone's add-on websites.

Affects:
Cause:

At the end of February the EasyList project were privately notified that there remained some unblocked adverts on Giorgio Maone's add-on websites which were slightly different to items usually blocked by the subscription. Instead of being an external file or text links, the images were encoded and saved in an embedded stylesheet, which meant that the only way to remove them would be to use element hiding rules to collapse the unwanted area.

Aware that the difficulty of filtering out images encoded in this method (data:image), I requested support for the format in the Adblock Plus forums, referring merely to "a familiar website" instead of explicitly naming the problematic domains. However, as such encoded images are not easily distinguished because they have no file name, it was decided that it might be better to wait and see whether the rules that RUAdList implemented were successful. While, under normal circumstances, filters would be added immediately, prior events (see Wladimir's and Giorgio's blogs) led the authors to concur that "we shouldn't start a cat and mouse game again".

This issue was then pushed to the back of our minds until the topic was publicly raised in the Adblock Plus forums on the ninth of April, with a user asking Giorgio the same question that he asked us: why were adverts still present on the NoScript website? Although Hubird, the Adversity author, explained that he believed that "the NoScript developer actively makes it difficult for subscription authors to remove ads from his site (changing site design in an effort to thwart attempts)", an assertion which MonztA, an EasyList author, agreed with, Giorgio responded with the following post, which I have included in its entirety to avoid possible misinterpretation:

@Hubird, @Montza:

No.

I haven't touched the "site design" for almost two years now, and I don't "actively make" anything about it.

Those units probably difficult to remove, but because they're just static images embedded in the page itself, which don't even perform any extra round trip to my own server -- let alone a 3rd party server -- and therefore don't implement any persistent tracking / behavioral stuff.

Of course the DOM being a bit random doesn't help either, but this picture of an evil and obsessive webmaster "actively" watching subscription authors and "changing site design in an effort to thwart attempts" is quite off base.

Giorgio Maone

I and several others interpreted this statement to mean that the websites would not be changed in the event that filters were added for the domains, and I therefore committed what would be the first of many rules, reasoning that "if a website is not actively altered I see no reason why EasyList should not filter out all the adverts".

There were initially a couple of minor changes to the subscription, which were ultimately suggested to have resulted from a lack of testing on the website, as we assumed that the pages would remain static. I further proposed that the filters should be more specific to avoid false positives, a change that was implemented for both NoScript.net and FlashGot.net.

However, we then became increasingly aware that the filters were ineffective when we checked the domains, and therefore subsequently altered the rules on several occasions for both websites (the full list of revisions for NoScript.net and the list of revisions for FlashGot.net and are publicly available from our repository). Although we were aware that the website was randomly altered by the server, we all agreed that certain elements of randomness, such as using alternative and altering tag names, was definitely not present when filters were first added for the domains.

I further discovered from MonztA, an EasyList author and moderator on the Adblock Plus forums, that Giorgio posted anonymously as "Guest" on two occasions to report issues with the website, something that I consider to be unfair given that he was an involved party in the discussion. It also became apparent that a member of the community was being provided with pages that did not include adverts on Giorgio's domains, making it increasingly difficult to successfully filter the unwanted sections.

We eventually decided, having attempted repeatedly to remove the adverts without false positives, that it would be more productive and informative to remove the filters specifically for Giorgio's domains from EasyList and explain the circumstances in a blog post. While I cannot say that this is an unexpected result given past events, I can say that I am disappointed that I could not take Giorgio at his word when he claimed that the "picture of [him as a] webmaster "actively" watching subscription authors and "changing site design in an effort to thwart attempts" is quite off base". Security depends on the people you trust, as any author of major browser extensions will be aware, and I am certainly less inclined to trust Giorgio after this incident.

Solution:

There aren't really many solutions to the current state of affairs. The use of images encoded and embedded in the stylesheet means that only element hiding rules may be used to collapse the adverts, and the constant randomisation of the domains, in addition to interventions to prevent existing rules from functioning, means that any publicly announced filters are usually invalid within a few hours. Furthermore, at least one member of the advert blocking community who might have been able to assist is unable to view the adverts after his IP address was identified and alternative pages provided.

While not an optimum solution, it would appear that the only certain method to avoid Giorgio's adverts is to cease visiting both domains entirely.

Update: 29/05/2011

Ares2 claims to have found some safe filters with which do not cause false positives, and I have therefore permitted him to commit these rules to the subscription.

MediaWiki headers and ids

written by Michael, on Apr 3, 2011 4:12:00 PM.

Problem:

MediaWiki headers may match a general element filter in subscriptions, and therefore be collapsed automatically.

Affects:
Cause:

MediaWiki automatically assigns ids to headers according to their content, which means that the header Example would also have an id of Example or, in CSS form, would be matched using the selector #Example. While not normally an issue, some general element hiding filters from subscriptions, such as ###Advert, may match the header text, and therefore hide the titles due to their identical ids.

Solution:

As the consequences of this issue are minimal, only collapsing a title, and only then if it matches one of the general element rules from the subscription, the problem will not be resolved in EasyList. The only method to resolve the issue effectively is to use the filter @@||wikipedia.org^$elemhide, although it will also prevent such rules being used to collapse their fundraising banners, another reason why the problem was not resolved in the subscription.

Who does anti-Adblock actually affect?

written by Michael, on Dec 21, 2010 7:47:00 AM.

Anti-Adblock scripts, which attempt to identify users of advert-blocking software and limit or, more commonly, disable access to content, appear to have become increasingly prevalent recently. Yet the techniques used to detect unwanted software are by no means infallible, and I have seen, on several occasions, that while they are certainly targeting particular groups of people, this has tended to include many innocent bystanders. I have therefore decided to outline the visitors who I believe are usually affected by such additional website "functionality".

People with scripting disabled

It is not uncommon for JavaScript to be disabled for reasons of security, with one of the most used Firefox add-ons, NoScript, being available specifically for this purpose. As anti-Adblock nearly always requires client scripting in order to detect advert filtration, it can just as easily cause problems for any security-conscious members of the online community [*].

People with special software requirements

Not everyone accesses the internet in exactly the same manner; some out of choice, some out of necessity. People in the latter group usually have a disability that prevents them from being able to interpret web pages as provided in standard browsers, and therefore may use alternatives to cater for their needs. However, as anti-Adblock techniques usually assume that there is only one possible display of a page, something that is simply inaccurate given that HTML, by definition, only marks pages rather than precisely defines them, people with customised web browsers may also be prevented from viewing page content. One of the most ludicrous examples that I have encountered is a site aimed at blind people that pointlessly mandates that all images are loaded in order to permit the textual content to be displayed.

People with poor connections to the website

Anti-Adblock techniques usually revolve around loading an item with a name that would usually be blocked by filter subscriptions and subsequently detecting whether or not it is present; however, this relies on the object being immediately available to be scrutinised. There are two reasons why this may not occur: the first is that the client could be using a dial-up internet connection and the second is a reliance on a particular server being constantly available for communicating data, a problem only exacerbated when the item is hosted on a third-party domain. Relying on these two suppositions is extremely risky, as no hosting or internet service provider can guarantee 100% up time or that every connection will be successful.

Search engine spiders

Search engine spiders usually only record the text of a page, with Google noting that "fancy features such as JavaScript [mean that] search engine spiders may have trouble crawling your site" ; however, requiring every item to be loaded on a domain, something that a bot may not do, means that all that the search engine will record is that advert blocking programs must not be used. This damages any search result rankings applied to the content because there is no relevant text to analyse and could consequently worsen the position of the domain when a particular term is requested.

As the above list demonstrates, there are many innocent people who are affected by attempts to implement anti-Adblock on a domain. The irony is that visitors with sufficiently advanced advert-blocking software are usually unaffected by such measures because of the presence of whitelists that protect necessary items and automatically updating subscriptions that distribute alterations negating detection.

So when you next consider adding anti-Adblock to a website, please first consider you you are actually going to cause problems for: visitors blocking adverts, people with slow internet connections or disabilities, or your own search engine reputation.

[*]

Incidentally, some people remove adverts to decrease the number of attack vectors available when visiting a website, and therefore can also fall into the category of "security-conscious" visitors.

Adblock Plus and other browser engines

written by Michael, on Nov 26, 2010 9:10:00 PM.

Problem:

Adverts are not removed when another add-on runs an alternative browser engine in Firefox.

Affects:
  • All variants of IE Tab

  • Any other extension that runs an alternative browser engine inside Firefox

Cause:

Adblock Plus relies on Firefox-specific functionality in order to control adverts, and the interfaces used to expose page data and thereby determine which items should be removed are different in other browsers, or in some cases entirely unavailable. This means that Adblock Plus is unable to retrieve any information about the loaded items on the page, and therefore cannot determine which should be removed.

Solution:

The only way to allow Adblock Plus to interact with a web page is to ensure that the content is rendered in Firefox itself; no other engine is compatible.

Wikimedia fundraising banners

written by Michael, on Nov 16, 2010 9:20:00 PM.

There is an almost annual contention over the Wikimedia fundraising banners that appear on websites including the widely visited Wikipedia requesting donations. As it is that time of year again, it appears prudent to formally explain the position of subscriptions towards such items.

EasyList policy dictates that self promotion is not specifically blocked by the subscriptions, although such items are equally not whitelisted if they happen to be removed by general filters; as the Wikimedia banners are present to inform people about the organisation's own products, they fall into this category. Furthermore, as we actively encourage website owners to request donations from users for financial support as an alternative to placing advertisements on their domain it is hypocritical to subsequently remove them using the subscriptions.

While there have been criticisms of the banners being annoying, this is not a reason for them to be blocked by EasyList. "Annoying" is a subjective quality that is very difficult to define and therefore implement as a fair and unbiased policy.

It should be noted that EasyPrivacy blocks tracking on the domains with the filter ||geoiplookup.wikimedia.org^, a rule that incidentally removes the banners. This filter is present to prevent the collection of personal data rather to fulfil than the additional purpose of removing the site notices that ultimately appears to have been served.

If you want to block the Wikimedia fundraising notice, just add the following rule to your "Custom filters" in Adblock Plus:

/w/index.php?title=*:bannercontroller

People who want to donate money to Wikimedia should do so on their donations page.

Filter subscriptions and important internet transactions

written by Michael, on Oct 29, 2010 7:36:00 PM.

Filter subscriptions can occasionally cause problems on websites, with issues ranging from text failing to display to videos not playing. However, issues are a lot more serious if they occur on websites where important transactions take place, such as banking, shopping, or booking travel arrangements, where a blocked item has the potential to prevent an order from being received. Furthermore, it should be expected that there is a higher incidences of false positives on, for example, shopping sites. On domains of this nature people usually want to see adverts, as the promotions could be what is attempting to be purchased, and want to be tracked to ensure that the company receives an order correctly.

The only way that it can be guaranteed that an advert-blocker does not cause issues is by disabling it when making an important transaction. If using the Adblock Plus add-on this can be achieved by middle-clicking on the extension icon in the browser to disable it, with the same action being used to revert to the original state. Alternatively, domains visited regularly may be protected by the Adblock Plus filter @@||example.com^document, where example.com is the name of the important website. Although this may mean that users have to temporarily endure advertisements and tracking, the guarantee that an important order has been received correctly is something much more important.

Gannett news websites

written by Michael, on Oct 3, 2010 6:57:00 PM.

Problem:

The EasyList and EasyPrivacy filter subscriptions prevent users from logging into and using the comments systems on the Gannett news websites, as well as using the next and previous buttons present in some articles.

Affects:

All 81 Gannett news websites

Cause:

In a winter 2009 redesign Gannett centralised the data that is served to their numerous domains by providing user and comment data through third-party services. While not normally an issue, the domains, all of which must load successfully for the comments to display correctly, are usually better known for the provision of advertisements and trackers:

This obviously causes problems for EasyList and EasyPrivacy, which by default block the domains because of the nature of the content served.

There are also nine additional domains used for the comments system only on The Indianapolis Star (indystar.com) that are also blocked by default for similar reasons:

Solution:

The items will not be whitelisted in the subscriptions because of the excessively permissive filters required, the length of which prevents them from being listed on the blog. I would therefore recommend that users subscribe to Fanboy's Gannett List in addition to any current subscriptions. Although there are redundant filters present in the subscription when used in conjunction with EasyList, it is currently one of the few solutions available to those with advert-blocking software who wish to use the Gannett comment system.