From tpataky at gmail.com Sun Aug 17 17:25:59 2025 From: tpataky at gmail.com (Tibor Pataky) Date: Sun, 17 Aug 2025 16:25:59 +0100 Subject: [Privoxy-users] External filter never executes Message-ID: Hi All, I've only just recently discovered privoxy and I thought I'll give it a try! One thing I can't get to work though is external filters (perhaps any filters at all?). I stripped down the config as much as possible, my user.action and user.filter files look like this: user.action: { +external-filter{my-filter} } / user.filter: EXTERNAL-FILTER: my-filter why you no work? /usr/bin/tee /var/tmp/privoxy/out When I run privoxy with: --no-daemon /etc/privoxy/config and run the following: curl --proxy localhost:8118 https://www.privoxy.org/ I get the following output: 2025-08-17 15:01:41.411 7ad19d4f0740 Info: Privoxy version 4.0.0 2025-08-17 15:01:41.411 7ad19d4f0740 Info: Program name: /workdir/privoxy/privoxy 2025-08-17 15:01:41.413 7ad19d4f0740 Error: Config option single-threaded disables connection keep-alive. 2025-08-17 15:01:41.413 7ad19d4f0740 Info: Loading filter file: /etc/privoxy/user.filter 2025-08-17 15:01:41.413 7ad19d4f0740 Re-Filter: Reading in filter "timed-filter" ("why you no work?") 2025-08-17 15:01:41.413 7ad19d4f0740 Info: Loading actions file: /etc/privoxy/user.action 2025-08-17 15:01:41.413 7ad19d4f0740 Info: Listening on port 8118 on IP address 0.0.0.0 2025-08-17 15:01:48.322 7ad19d4f0740 Request: www.privoxy.org:443/ 2025-08-17 15:01:48.322 7ad19d4f0740 Actions: +external-filter{my-filter} This deceptively shows that it executes my-filter, but it never actually runs the tee command, the file under /var/tmp/privoxy never appeared. I got to the point where I built privoxy from source (the v_4_0_0 tag) with debug symbols and ran it under gdb. I set various breakpoints in handle_established_connection, but couldn't really figure out what is going wrong. What I noticed is that the variable buffer_and_filter_content which guards the call to execute_content_filters is only ever set where it is declared. The main loop in handle_established_connection exits after a couple of iterations when it runs onto the break statement at line 3413. As far as I can tell the only place where buffer_and_filter_content is possibly set to a nonzero value is in line 4111, but execution never reaches this line. At this point I'm really out of ideas what to try next... Is there some extra config I forgot to set to enable external filters? Is it a header that's behind this? Is something possibly wrong with the SSL/TLS setup? What should I check for in gdb? Kind regards, Tibor Pataky From fk at fabiankeil.de Sun Aug 17 18:43:43 2025 From: fk at fabiankeil.de (Fabian Keil) Date: Sun, 17 Aug 2025 18:43:43 +0200 Subject: [Privoxy-users] External filter never executes In-Reply-To: References: Message-ID: <20250817184343.6270ff6a.fk@fabiankeil.de> Tibor Pataky via Privoxy-users wrote on 2025-08-17 at 16:25:59: > I've only just recently discovered privoxy and I thought I'll give it a try! Great. > One thing I can't get to work though is external filters (perhaps any > filters at all?). > I stripped down the config as much as possible, my user.action and > user.filter files look like this: > user.action: > { +external-filter{my-filter} } > / > > user.filter: > EXTERNAL-FILTER: my-filter why you no work? > /usr/bin/tee /var/tmp/privoxy/out > > When I run privoxy with: --no-daemon /etc/privoxy/config > and run the following: curl --proxy localhost:8118 https://www.privoxy.org/ > I get the following output: > 2025-08-17 15:01:41.411 7ad19d4f0740 Info: Privoxy version 4.0.0 > 2025-08-17 15:01:41.411 7ad19d4f0740 Info: Program name: > /workdir/privoxy/privoxy > 2025-08-17 15:01:41.413 7ad19d4f0740 Error: Config option single-threaded > disables connection keep-alive. > 2025-08-17 15:01:41.413 7ad19d4f0740 Info: Loading filter file: > /etc/privoxy/user.filter > 2025-08-17 15:01:41.413 7ad19d4f0740 Re-Filter: Reading in filter > "timed-filter" ("why you no work?") > 2025-08-17 15:01:41.413 7ad19d4f0740 Info: Loading actions file: > /etc/privoxy/user.action > 2025-08-17 15:01:41.413 7ad19d4f0740 Info: Listening on port 8118 on IP > address 0.0.0.0 > 2025-08-17 15:01:48.322 7ad19d4f0740 Request: www.privoxy.org:443/ > 2025-08-17 15:01:48.322 7ad19d4f0740 Actions: +external-filter{my-filter} > > This deceptively shows that it executes my-filter, but it never actually > runs the tee command, the file under /var/tmp/privoxy never appeared. Actually the "Actions:" message only shows that the external-filter{} action "applies". To actually execute any filters Privoxy has to buffer the content and it looks like you didn't enable HTTPS inspection so Privoxy isn't doing that. > I got to the point where I built privoxy from source (the v_4_0_0 tag) with > debug symbols and ran it under gdb. > I set various breakpoints in handle_established_connection, but couldn't > really figure out what is going wrong. What I noticed is that the variable > buffer_and_filter_content which guards the call to execute_content_filters > is only ever set where it is declared. The main loop in > handle_established_connection exits after a couple of iterations when it > runs onto the break statement at line 3413. As far as I can tell the only > place where buffer_and_filter_content is possibly set to a nonzero value is > in line 4111, but execution never reaches this line. > > At this point I'm really out of ideas what to try next... For a quick test, try a http:// URL. > Is there some extra config I forgot to set to enable external filters? As mentioned above, to filter https:// content you have to enable HTTPS inspection. There's a HOWTO at: > Is it a header that's behind this? No. > What should I check for in gdb? Enabling HTTPS inspection should be sufficient to solve this without involving gdb. Don't forget to remove the single-threaded directive again as it results in poor performance. Fabian -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 833 bytes Desc: OpenPGP digital signature URL: From tpataky at gmail.com Mon Aug 18 21:08:16 2025 From: tpataky at gmail.com (Tibor Pataky) Date: Mon, 18 Aug 2025 20:08:16 +0100 Subject: [Privoxy-users] External filter never executes In-Reply-To: <20250817184343.6270ff6a.fk@fabiankeil.de> References: <20250817184343.6270ff6a.fk@fabiankeil.de> Message-ID: Thanks Fabian! The problem was indeed that I did not set up HTTPS inspection correctly! After going through the steps in the howto, everything works now as it should! Kind regards, Tibor Pataky On Sun, 17 Aug 2025 at 17:43, Fabian Keil via Privoxy-users < privoxy-users at lists.privoxy.org> wrote: > Tibor Pataky via Privoxy-users wrote on > 2025-08-17 at 16:25:59: > > > I've only just recently discovered privoxy and I thought I'll give it a > try! > > Great. > > > One thing I can't get to work though is external filters (perhaps any > > filters at all?). > > I stripped down the config as much as possible, my user.action and > > user.filter files look like this: > > user.action: > > { +external-filter{my-filter} } > > / > > > > user.filter: > > EXTERNAL-FILTER: my-filter why you no work? > > /usr/bin/tee /var/tmp/privoxy/out > > > > When I run privoxy with: --no-daemon /etc/privoxy/config > > and run the following: curl --proxy localhost:8118 > https://www.privoxy.org/ > > I get the following output: > > 2025-08-17 15:01:41.411 7ad19d4f0740 Info: Privoxy version 4.0.0 > > 2025-08-17 15:01:41.411 7ad19d4f0740 Info: Program name: > > /workdir/privoxy/privoxy > > 2025-08-17 15:01:41.413 7ad19d4f0740 Error: Config option single-threaded > > disables connection keep-alive. > > 2025-08-17 15:01:41.413 7ad19d4f0740 Info: Loading filter file: > > /etc/privoxy/user.filter > > 2025-08-17 15:01:41.413 7ad19d4f0740 Re-Filter: Reading in filter > > "timed-filter" ("why you no work?") > > 2025-08-17 15:01:41.413 7ad19d4f0740 Info: Loading actions file: > > /etc/privoxy/user.action > > 2025-08-17 15:01:41.413 7ad19d4f0740 Info: Listening on port 8118 on IP > > address 0.0.0.0 > > 2025-08-17 15:01:48.322 7ad19d4f0740 Request: www.privoxy.org:443/ > > 2025-08-17 15:01:48.322 7ad19d4f0740 Actions: +external-filter{my-filter} > > > > This deceptively shows that it executes my-filter, but it never actually > > runs the tee command, the file under /var/tmp/privoxy never appeared. > > Actually the "Actions:" message only shows that the external-filter{} > action > "applies". > > To actually execute any filters Privoxy has to buffer the content and it > looks like you didn't enable HTTPS inspection so Privoxy isn't doing that. > > > I got to the point where I built privoxy from source (the v_4_0_0 tag) > with > > debug symbols and ran it under gdb. > > I set various breakpoints in handle_established_connection, but couldn't > > really figure out what is going wrong. What I noticed is that the > variable > > buffer_and_filter_content which guards the call to > execute_content_filters > > is only ever set where it is declared. The main loop in > > handle_established_connection exits after a couple of iterations when it > > runs onto the break statement at line 3413. As far as I can tell the only > > place where buffer_and_filter_content is possibly set to a nonzero value > is > > in line 4111, but execution never reaches this line. > > > > At this point I'm really out of ideas what to try next... > > For a quick test, try a http:// URL. > > > Is there some extra config I forgot to set to enable external filters? > > As mentioned above, to filter https:// content you have to enable > HTTPS inspection. There's a HOWTO at: > > > > Is it a header that's behind this? > > No. > > > What should I check for in gdb? > > Enabling HTTPS inspection should be sufficient to solve this without > involving gdb. > > Don't forget to remove the single-threaded directive again as it results > in poor performance. > > Fabian > _______________________________________________ > Privoxy-users mailing list > Privoxy-users at lists.privoxy.org > https://lists.privoxy.org/mailman/listinfo/privoxy-users > From Steven.Kolins at NCIS.org Thu Aug 28 02:34:27 2025 From: Steven.Kolins at NCIS.org (Steven Kolins) Date: Wed, 27 Aug 2025 20:34:27 -0400 Subject: [Privoxy-users] =?utf-8?q?Macos=E2=80=A6_on_Apple_Silicon=3F?= Message-ID: <1E28EDF4-FBC4-4F51-B4D0-DD2E15A8DAB7@NCIS.org> Hi, Even a beta to try? = - - - - - - - = Steven Kolins mailto:Steven.Kolins at NCIS.org Possess a pure, kindly and radiant heart! From iansilvester at fastmail.fm Thu Aug 28 03:50:18 2025 From: iansilvester at fastmail.fm (Ian Silvester) Date: Wed, 27 Aug 2025 21:50:18 -0400 Subject: [Privoxy-users] =?utf-8?q?Macos=E2=80=A6_on_Apple_Silicon=3F?= In-Reply-To: <1E28EDF4-FBC4-4F51-B4D0-DD2E15A8DAB7@NCIS.org> References: <1E28EDF4-FBC4-4F51-B4D0-DD2E15A8DAB7@NCIS.org> Message-ID: <13196bba-03c0-4823-b429-0277a55ef3f7@app.fastmail.com> Hi Steven, Unfortunately I don't possess an Apple Silicon Mac on which to compile the binary, and the most recent version of Apple's SDK does not offer cross-compilation to an Apple Silicon target. If you are interested in downloading the Apple SDK and our project's files, then you might be the first person (that we know of) to run Privoxy on Apple Silicon? Sorry not to have better news, Ian On Wed, 27 Aug 2025, at 20:34, Steven Kolins via Privoxy-users wrote: > Hi, > > Even a beta to try? > > > = - - - - - - - = > Steven Kolins > mailto:Steven.Kolins at NCIS.org > Possess a pure, kindly and radiant heart! > > _______________________________________________ > Privoxy-users mailing list > Privoxy-users at lists.privoxy.org > https://lists.privoxy.org/mailman/listinfo/privoxy-users From fk at fabiankeil.de Sun Aug 31 12:14:01 2025 From: fk at fabiankeil.de (Fabian Keil) Date: Sun, 31 Aug 2025 12:14:01 +0200 Subject: [Privoxy-users] =?utf-8?q?Macos=E2=80=A6_on_Apple_Silicon=3F?= In-Reply-To: <13196bba-03c0-4823-b429-0277a55ef3f7@app.fastmail.com> References: <1E28EDF4-FBC4-4F51-B4D0-DD2E15A8DAB7@NCIS.org> <13196bba-03c0-4823-b429-0277a55ef3f7@app.fastmail.com> Message-ID: <20250831121401.5b7344da.fk@fabiankeil.de> Ian Silvester via Privoxy-users wrote on 2025-08-27 at 21:50:18: > Unfortunately I don't possess an Apple Silicon Mac on which to > compile the binary, and the most recent version of Apple's SDK > does not offer cross-compilation to an Apple Silicon target. > > If you are interested in downloading the Apple SDK and our > project's files, then you might be the first person (that > we know of) to run Privoxy on Apple Silicon? It looks like Privoxy is available for Apple Silicon in Homebrew: https://formulae.brew.sh/formula/privoxy#default It seems to lack HTTP inspection and Brotli decompression support, though. Fabian -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 833 bytes Desc: OpenPGP digital signature URL: From Steven.Kolins at NCIS.org Sun Aug 31 14:48:41 2025 From: Steven.Kolins at NCIS.org (Steven Kolins) Date: Sun, 31 Aug 2025 08:48:41 -0400 Subject: [Privoxy-users] =?utf-8?q?Macos=E2=80=A6_on_Apple_Silicon=3F?= In-Reply-To: <20250831121401.5b7344da.fk@fabiankeil.de> References: <1E28EDF4-FBC4-4F51-B4D0-DD2E15A8DAB7@NCIS.org> <13196bba-03c0-4823-b429-0277a55ef3f7@app.fastmail.com> <20250831121401.5b7344da.fk@fabiankeil.de> Message-ID: <9D2C05EE-EFE2-4241-9EE1-E890282D5BD3@NCIS.org> Well that?s a little news? > On Aug 31, 2025, at 6:14?AM, Fabian Keil via Privoxy-users wrote: > > Ian Silvester via Privoxy-users wrote on 2025-08-27 at 21:50:18: > >> Unfortunately I don't possess an Apple Silicon Mac on which to >> compile the binary, and the most recent version of Apple's SDK >> does not offer cross-compilation to an Apple Silicon target. >> >> If you are interested in downloading the Apple SDK and our >> project's files, then you might be the first person (that >> we know of) to run Privoxy on Apple Silicon? > > It looks like Privoxy is available for Apple Silicon in Homebrew: > https://formulae.brew.sh/formula/privoxy#default > > It seems to lack HTTP inspection and Brotli decompression support, though. > > Fabian > _______________________________________________ > Privoxy-users mailing list > Privoxy-users at lists.privoxy.org > https://lists.privoxy.org/mailman/listinfo/privoxy-users = - - - - - - - = Steven Kolins mailto:Steven.Kolins at NCIS.org Possess a pure, kindly and radiant heart! From smkolins at mac.com Sun Aug 31 15:11:19 2025 From: smkolins at mac.com (Steven Kolins) Date: Sun, 31 Aug 2025 09:11:19 -0400 Subject: [Privoxy-users] =?utf-8?q?Macos=E2=80=A6_on_Apple_Silicon=3F?= In-Reply-To: <9D2C05EE-EFE2-4241-9EE1-E890282D5BD3@NCIS.org> References: <1E28EDF4-FBC4-4F51-B4D0-DD2E15A8DAB7@NCIS.org> <13196bba-03c0-4823-b429-0277a55ef3f7@app.fastmail.com> <20250831121401.5b7344da.fk@fabiankeil.de> <9D2C05EE-EFE2-4241-9EE1-E890282D5BD3@NCIS.org> Message-ID: Hmmm - something still not right. wont start. I checked permissions, and locations, of various files like logfile( which I amended from the attempt at /var/log/privocy to /usr/local/var/log/privoxy which was left over from migrating)? but still no joy. Not much time left this morning so I?ll poke at it later today and or tomorrow. > On Aug 31, 2025, at 8:48?AM, Steven Kolins via Privoxy-users wrote: > > Well that?s a little news? > >> On Aug 31, 2025, at 6:14?AM, Fabian Keil via Privoxy-users wrote: >> >> Ian Silvester via Privoxy-users wrote on 2025-08-27 at 21:50:18: >> >>> Unfortunately I don't possess an Apple Silicon Mac on which to >>> compile the binary, and the most recent version of Apple's SDK >>> does not offer cross-compilation to an Apple Silicon target. >>> >>> If you are interested in downloading the Apple SDK and our >>> project's files, then you might be the first person (that >>> we know of) to run Privoxy on Apple Silicon? >> >> It looks like Privoxy is available for Apple Silicon in Homebrew: >> https://formulae.brew.sh/formula/privoxy#default >> >> It seems to lack HTTP inspection and Brotli decompression support, though. >> >> Fabian >> _______________________________________________ >> Privoxy-users mailing list >> Privoxy-users at lists.privoxy.org >> https://lists.privoxy.org/mailman/listinfo/privoxy-users > > = - - - - - - - = > Steven Kolins > mailto:Steven.Kolins at NCIS.org > Possess a pure, kindly and radiant heart! > > _______________________________________________ > Privoxy-users mailing list > Privoxy-users at lists.privoxy.org > https://lists.privoxy.org/mailman/listinfo/privoxy-users = - - - - - - - = Steven Kolins mailto:smkolins at mac.com http://smk99.blogspot.com/ Possess a pure, kindly and radiant heart! From smkolins at mac.com Sun Aug 31 20:43:20 2025 From: smkolins at mac.com (Steven Kolins) Date: Sun, 31 Aug 2025 14:43:20 -0400 Subject: [Privoxy-users] =?utf-8?q?Macos=E2=80=A6_on_Apple_Silicon=3F?= In-Reply-To: References: <1E28EDF4-FBC4-4F51-B4D0-DD2E15A8DAB7@NCIS.org> <13196bba-03c0-4823-b429-0277a55ef3f7@app.fastmail.com> <20250831121401.5b7344da.fk@fabiankeil.de> <9D2C05EE-EFE2-4241-9EE1-E890282D5BD3@NCIS.org> Message-ID: <526D99B1-CC83-41B1-9D3A-B83FF980BA07@mac.com> I discovered "brew services start privoxy? in the ?More info? of the 4.0.0 installer. That worked (? the permissions and dir changes?) Anyway, it is running with my config etc files from the previous generations of using it. So yes, it works, ? tweaking. > On Aug 31, 2025, at 9:11?AM, Steven Kolins via Privoxy-users wrote: > > Hmmm - something still not right. wont start. I checked permissions, and locations, of various files like logfile( which I amended from the attempt at /var/log/privocy to /usr/local/var/log/privoxy which was left over from migrating)? but still no joy. Not much time left this morning so I?ll poke at it later today and or tomorrow. > >> On Aug 31, 2025, at 8:48?AM, Steven Kolins via Privoxy-users wrote: >> >> Well that?s a little news? >> >>> On Aug 31, 2025, at 6:14?AM, Fabian Keil via Privoxy-users wrote: >>> ? >>> It looks like Privoxy is available for Apple Silicon in Homebrew: >>> https://formulae.brew.sh/formula/privoxy#default >>> >>> It seems to lack HTTP inspection and Brotli decompression support, though. >>> >>> Fabian = - - - - - - - = Steven Kolins mailto:smkolins at mac.com http://smk99.blogspot.com/ Possess a pure, kindly and radiant heart! From Steven.Kolins at NCIS.org Sun Aug 31 20:42:12 2025 From: Steven.Kolins at NCIS.org (Steven Kolins) Date: Sun, 31 Aug 2025 14:42:12 -0400 Subject: [Privoxy-users] =?utf-8?q?Macos=E2=80=A6_on_Apple_Silicon=3F?= In-Reply-To: References: <1E28EDF4-FBC4-4F51-B4D0-DD2E15A8DAB7@NCIS.org> <13196bba-03c0-4823-b429-0277a55ef3f7@app.fastmail.com> <20250831121401.5b7344da.fk@fabiankeil.de> <9D2C05EE-EFE2-4241-9EE1-E890282D5BD3@NCIS.org> Message-ID: I discovered "brew services start privoxy? in the ?More info? of the 4.0.0 installer. That worked (? the permissions and dir changes?) Anyway, it is running with my config etc files from the previous generations of using it. So yes, it works, ? tweaking. > On Aug 31, 2025, at 9:11?AM, Steven Kolins via Privoxy-users wrote: > > Hmmm - something still not right. wont start. I checked permissions, and locations, of various files like logfile( which I amended from the attempt at /var/log/privocy to /usr/local/var/log/privoxy which was left over from migrating)? but still no joy. Not much time left this morning so I?ll poke at it later today and or tomorrow. > >> On Aug 31, 2025, at 8:48?AM, Steven Kolins via Privoxy-users wrote: >> >> Well that?s a little news? >> >>> On Aug 31, 2025, at 6:14?AM, Fabian Keil via Privoxy-users wrote: >>> ? >>> It looks like Privoxy is available for Apple Silicon in Homebrew: >>> https://formulae.brew.sh/formula/privoxy#default >>> >>> It seems to lack HTTP inspection and Brotli decompression support, though. >>> >>> Fabian = - - - - - - - = Steven Kolins mailto:Steven.Kolins at NCIS.org Possess a pure, kindly and radiant heart!